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PREFACE 


For many years following its publication in 1974, "TIME AND FREQUENCY: Theory 
and Fundamentals," a volume edited by Byron E. Blair and published as NBS Monograph 140, 
served as a common reference for those engaged in the characterization of very stable clocks and 
oscillators. Monograph 140 has gradually become outdated, and with the recent issuance of a 
new military specification, MIL-0-55310B, which covers general specifications for crystal oscilla- 
tors, it has become especially clear that Monograph 140 no longer meets the needs it so ably 
served in earlier years. During development of the new military specification, a process involving 
discussion and input from many quarters, a key author of the specification, John Vig of the US 
Army Electronics Technology and Devices, urged the National Bureau of Standards (now the 
National Institute of Standards and Technology, NIST) to issue a revised publication to serve as 
reference for the characterization of clocks and oscillators. With NIST having agreed to this 
task, the framers of the military specification used the nomenclature "NBS Monograph 140R" in 
their document, anticipating a revised (R) volume which had not yet been prepared. 

Considering the availability of a number of newer books in the time and frequency field, 
the rewriting of a major volume like Monograph 140 seemed inappropriate. The real need has 
not been for rework of everything in Monograph 140, but only for those parts which provide 
reference to definitions and methods for measurement and characterization of clocks and oscilla- 
tors, subjects which are fully covered in a number of papers distributed through a variety of 
conference proceedings, books, and journals. For the near term, we concluded that the most 
effective procedure would be to collect a representative set of these papers into one reference 
source with introductory comments which permit the reader to quickly access material required 
to meet particular needs. Thus, we arrived at this particular collection, The editors’ challenge 
has been to select representative papers, to organize them in a convenient manner, and to deal 
with errata and notation inconsistencies in a reasonable manner. In the longer term, the materi- 
al in this volume needs to be more completely integrated. This task would profitably await 
further developments in the area of phase noise measurements. 


Donald B, Sullivan 
David W. Allan 
David A. Howe 
Fred L. Walls 


Boulder, Colorado 
February 28, 1990 
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CHARACTERIZATION OF CLOCKS AND OSCILLATORS 
D.B. Sullivan, D.W. Allan, D.A. Howe and F.L. Walls, Editors 


Time and Frequency Division 
National Institute of Standards and Technology 
Boulder, Colorado 80303 


This is a collection of published papers assembled as a reference for those in- 
volved in characterizing and specifying high-performance clocks and oscillators. It 
is an interim replacement for NBS Monograph 140, Time and Frequency: Theory 
and Fundamentals, an older volume of papers edited by Byron E. Blair. This 
current volume includes tutorial papers, papers on standards and definitions, and 
a collection of papers detailing specific measurement and analysis techniques. 
The discussion in the introduction to the volume provides a guide to the content 
of the papers, and tables and graphs provide further help in organizing methods 
described in the papers. 


Key words: Allan variance, clocks, frequency, oscillators, phase noise, spectral 
density, time, two-sample variance. 


A. INTRODUCTION 
A.l OVERVIEW 


The papers in this volume are organized into three groups: Introductory and Tutorial 
Papers, Papers on Definitions and Standards, and Supporting Papers. The three sections (A.2, 
A.3, and A.4) immediately following this introduction provide overviews of each of the three 
groups of papers with comments on each paper. The arrangement of the papers in this particu- 
lar order is somewhat arbitrary, since, for example, the first two papers under Supporting Papers 
could be included with the Introductory and Tutorial Papers, while paper B.4 could easily be 
placed with the Supporting Papers. Our rationale for the first group of papers (discussed in 
more detail in section A.2) is that, taken as a group, they provide reasonably complete coverage 
of the concepts used in characterizing clocks and oscillators. Several of the papers, taken individ- 
ually, are good introductory papers, but, for this publication, need to be complemented with 
additional material to provide coverage of an appropriate range of topics. 

The second group (section C) of three papers discussed in section A.3 were specifically 
written to address definitions and standards. This is a particularly important section, since 
consistency in specification of performance can only be achieved if manufacturers and users refer 
to the same measurement and characterization parameters. 

The Supporting Papers in section D provide additional discussion of topics introduced in 
the first group. The first papers in this group (D.1 and D.2) also provide good introductory 
material which might be used with section B to gain a better understanding of the concepts. 

Section A.5 provides a table and graph designed to help the reader select a measurement 
method to meet a particular need. To make this useful, it was kept simple and must therefore 
be used with care. Such tabular information can never be arranged well enough to anticipate all 
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of the wide range of measurement situations which might be encountered. However, it can serve 
as a starting point for the decision-making process. 

Section A.6 contains some new material which should be helpful in understanding the 
relationship between the Allan variance and the modified Allan variance. Since these ideas are 
unpublished, we include them here rather than with the papers on those topics. This section is 
followed by a reading list with references to major articles and books which can be used as 
supplementary resources. Because some of the papers include extensive reference lists, we have 
limited our list to works which are either very comprehensive or only recently published. Partic- 
ularly extensive reference lists are included with papers B.1, B.2, C.1, C.3, D.1, and D.2. 

Since notation and definitions have changed over the period bridged by these papers, we 
have highlighted problem areas on the papers with an asterisk (*). A note directs the reader to 
the Appendix where the particular problem is discussed. We have also used this device to 
highlight inconsistencies and the usual typographic and other errors which creep into the litera- 
ture. The page numbers of the original publications are retained, but we have also used a 
continuous page numbering to simplify location of items in the volume. 

The topical index on page xi organizes much of the material in the papers under a few 
key subject headings. This index provides a shortcut to locating material on a particular topic. 


A2 COMMENTS ON INTRODUCTORY AND TUTORIAL PAPERS 


Paper B.1 in this section, by Howe, Allan, and Barnes, was originally prepared and 
presented as a tutorial paper and has been used with success as an introductory paper in our 
annual Time and Frequency Seminar. This paper is now 9 years old, so there are a substantial 
number of notes which relate to updates in notation. The paper is nevertheless highly readable 
and introduces many of the key measurement methods, providing circuit diagrams with enough 
specific detail to be useful in real laboratory situations, Furthermore, it includes discussion and 
examples on handling of data which are useful for practical application of the concepts. The 
paper presents a particularly useful discussion of the pitfalls encountered in digitizing data, a 
problem which is often overlooked. 

The second paper (B.2) by Stein is more advanced and those familiar with the general 
concepts may find it a better starting point. This and other papers in this collection cite earlier 
IEEE recommendations on measures of frequency stability and, while much of this has not 
changed, there is a new IEEE standard (paper C.1). In general, the reader should consult the 
overview and papers of section C if there is any question concerning definitions or terminology. 
Paper B.2 is quite comprehensive, introducing topics (not covered in paper B.1) such as the 
modified Allan variance, the delay-line-phase-noise-measurement system, and the use of fre- 
quency synthesis to reach frequencies far from normally available reference frequencies. 

The materials in papers B.1 and B.2, aside from differences in level of presentation, are 
organized in quite different ways. The Howe-Allan-Barnes paper goes directly to the measure- 
ment concepts and then describes the means for analyzing the output data and understanding the 
confidence of the measurements. On the other hand, the Stein paper carefully lays out the 
theoretical background needed to analyze the data before introducing the measurement concepts. 
Both papers cover time-domain and frequency-domain measurements. 

Paper B.3 by Allan reviews the concepts of the two-sample or Allan variance and the 
modified Allan variance showing how classical statistical methods fail to usefully describe the 
time-domain performance of good oscillators. The Allan variance concept is also introduced in 
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papers B.1 and B.2, and the modified Allan variance is described further in papers D.4 and D.5. 
The presentation in paper B.3 is particularly useful in that it discusses general aspects of perfor- 
mance of different types of oscillators (quartz, rubidium, hydrogen, and cesium) providing the 
basis for prediction of time errors, a topic which may prove useful to those who must develop 
system specifications. 

Paper B.4 by Walls, Clements, Felton, Lombardi, and Vanek adds to the discussion of 
frequency-domain measurements providing information on methods which can be used to in- 
crease the dynamic range for both carrier frequency and for Fourier frequencies up to 10 percent 
from the carrier. With some aerospace hardware now carrying phase-noise specifications, this is 
an important addition to the literature. 


A3 COMMENTS ON PAPERS ON STANDARDS AND DEFINITIONS 


The first paper in this group (paper C.1) outlines the standard terminology now used for 
fundamental frequency and time metrology. This document was widely circulated for comment 
during the draft stage and, with its acceptance by IEEE as a standard, supersedes the earlier 
reference (paper C.2) which had served as the foundation for characterization of frequency 
stability. This latter paper is included because it is so widely cited, and the reader will probably 
be confronted with specifications based on its recommendations. Paper C.2 contains additional 
material on applications of stability measures and measurement techniques including a useful 
discussion of some of the common hazards in measurements. Paper C.1 restricts itself to very 
concise statements of the definitions. 

The reader will note that the updated terminology in the first paper (C.1) varies in a 
number of minor ways from the earlier paper (C.2). A notable addition to definitions is the 
introduction of script "ell", 2(f), which has become an important measure of phase noise. This 
quantity was previously defined as the ratio of the power in one sideband, due to phase modu- 
lation to the total signal power. For Fourier frequencies far from the carrier, this quantity can 
be simply related to the usual spectral densities which are the quantities that are generally mea- 
sured, but the relation breaks down in the important region near the carrier. To resolve this 
problem, the new standard defines the approximate relation between ¢(f) and spectral density as 
being exact and applicable for any Fourier frequency. 

The third paper in this group (paper C.3), from the 1986 report of the International 
Radio Consultative Committee (CCIR), presents the definitions and terminology which have 
been accepted for international use by this body. The material in this particularly readable 
document is fairly consistent with the IEEE standard and would be useful to those involved in 
specification of performance for international trade. A number of minor changes to this docu- 
ment have been recommended by different delegations to the CCIR and these will likely be 
made in their next publication. 


A.4 COMMENTS ON SUPPORTING PAPERS 
Papers D.1 and D.2 are included in this collection for a number of reasons. First, they 


provide alternative introductions to the general topic of oscillator characterization. And second, 
they include material not fully covered by introductory papers, B.1 and B.2. 
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The first of these (D.1) by Lesage and Audoin covers most of the same ground as papers 
B.1 and B.2, but, in addition, includes a nice discussion of characterization of frequency stability 
via filtering of phase or frequency noise, a method which may be especially useful for rapid, 
automated measurements where high accuracy is not required. Furthermore, this paper discusses 
characterization of stable laser sources, a topic not covered in any of the other reference papers. 

Paper D.2 by Lance, Seal, and Labaar limits itself to discussion of the measurement of 
phase noise and amplitude-modulation (AM) noise. The paper presents a detailed discussion of 
delay-line measurement methods which can be used if a second reference oscillator is not 
available. The delay-line concept is also introduced in B.2 and B.4, but in much less detail. 
While the delay-line method is less sensitive (for lower Fourier frequency) than two-oscillator 
methods, it is easier to implement. The paper contains many good examples which the reader 
will find useful. 

A complete discussion of AM noise is beyond the scope of this volume. AM noise is 
usually ignored in the measurement and specification of phase noise in sources under the as- 
sumption that the AM noise is always less than the phase noise. This assumption is generally 
true only for Fourier frequencies close to the carrier. At larger Fourier frequencies the normal- 
ized AM noise can be the same order of magnitude as the phase noise. In systems with active 
amplitude leveling, the normalized AM noise can be higher than the phase noise. Under this 
condition the AM to PM conversion in the rest of the system may degrade the overall phase 
noise performance, For these reasons, we cannot ignore amplitude noise altogether. Paper D.2 
provides a useful discussion of amplitude noise. Note 1 in appendix E provides further informa- 
tion on definitions, notation and, in particular, the specification of added phase noise and 
amplitude noise for signal-handling components. 

The next contribution (D.3) provides substantially more detail on the extension of the 
time-domain, dual-mixer concept for highly accurate time and time-interval measurements. The 
basic dual-mixer ideas are included in papers B.1 and B.2. 

Paper D.4, published recently, provides the first quantitative treatment of confidence 
estimates for phase-noise measurements. To the best of our knowledge, this is the only available 
treatment of this important subject. We expect to see additional papers on this topic in the 
future, 

Paper D.5 discusses the modified Allan variance in more detail than the introductory 
papers B.1, B.2, and B.3. It is followed by the Lesage-Ayi paper (D.6) which provides analytical 
expressions for the standard set of power-law noise types and also includes discussion of the 
uncertainty of the estimate of the modified Allan variance. 

Linear frequency drift in oscillators is treated by Barnes in paper D.7. As noted in this 
Paper, even with correction for drift, the magnitude of drift error eventually dominates all time 
uncertainties in clock models. Drift is particularly important in certain oscillators (e.g., quartz 
oscillators) and a proper measure and treatment of drift is essential. As with other topics 
treated by this group of papers, introductory papers B.1, B.2, and B.3 present some discussion of 
frequency drift, but D.7 is included because it contains a much more comprehensive discussion of 
the subject. 

The final paper (D.8) by Barnes and Allan contains the most recent treatment of mea- 
surements made with dead times between them. Paper C.2 introduced the use of bias functions, 
B, and B,, which can be used to predict the Allan variance for one set of parameters based on 
another set (for the power-law noise models). This last paper extends those ideas, introducing a 
third bias function, B,, which can be used to translate the Allan variance between cases where 
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dead time is accumulated at the end and where dead time is distributed between measurements, 
a useful process for many data-acquisition situations. 


AS GUIDE TO SELECTION OF MEASUREMENT METHODS 


The table and graph in this section are quick guides to performance limits of the different 
methods as well as indications of advantages and disadvantages of each. The ideas presented 
here are drawn from papers B.1 and B.4, but we have modified and expanded the material to 
make it more comprehensive. The table has been kept simple, so the suggested methods should 
be viewed as starting points only. They cannot possibly cover all measurement situations. 

For a given measurement task, it is often best to start with a quick, simple measurement 
which will then help to define the problem. For example, faced with the need to characterize an 
oscillator, a good starting point might be to feed the output of that oscillator along with the 
output of a similar, but more stable, oscillator into a good mixer and then look at the output. If 
the two can be brought into quadrature by tuning one of the oscillators or by using a phase- 
locked loop, then the output can be fed to a spectrum analyzer to get an immediate, at least 
qualitative idea, of the performance of the oscillator. This mixing process, which brings the 
fluctuations to baseband where measurement is much more straightforward, is basic to many of 
the measurement methods. A large number of measurement problems can probably be resolved 
with this simple, single-conversion, heterodyne arrangement. If the simplest approach is insuffi- 
cient, then some of the more advanced methods outlined below can be used. 

There are many ways to go about categorizing the various measurement methods. Since 
this volume is aimed at practical measurements, we choose to use the characteristics of the 
measurement circuit as the basis for sorting. In this arrangement we have (1) direct measure- 
ments where no signal mixers are used, (2) heterodyne measurements where two unequal fre- 
quencies are involved, and (3) homodyne measurements where two equal frequencies are in- 
volved. These methods are listed below. 


I. Direct Measurements 
1, Measurements at the Fundamental Frequency 
2. Measurements after Multiplication/Division 
Il. 
1. Single-Conversion Methods 
2. Multiple-Conversion Methods 
3. Time-Difference Method 
a. Dual-Mixer, Time-Difference Method 
TI. Homodyne Measurements 
1. Phase-Lock-Loop Methods (two oscillators) 
a. Loose-Phase-Lock-Loop Method 
b.  Tight-Phase-Lock-Loop Method 
2. Discriminator Methods (single oscillator) 
a. Cavity-Discriminator Method 
b. Delay-Line Method 
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Table 1. Guide to Selection of Measurement Methods. 


Measurement Time Time Frequen Frequi 
Method Accuracy* srt Acne Stability? Advantages Disadvantages 
I day) o(7) 


I. Direct Measurements 


See Note Limited by Limited by Limited Very simple to . 
1, At the Fundamental Frequency # 2 in time base time beset time Reset eae fn acpcopetae foe high walitiy oF 
Appendix stability accuracy stability cillators, 
a : See Note Limited by Limited by Limited by vi le to perform; for fi Provides odest i 
2. After Multiplication/Division #2in time base time base time base Gy manpuoue factor nN of above pane and as ee 
Appendix stability accuracy _ stability noise increases in dB by 20logN. fers similar limitations. 


Il. Heterodyne Measurements 


Measurement noise can typically Minimum r determined by period 
be made less than oscillator in- of beat frequency, typically not ad- 


1, Single-Conversion Methods ~10° bilities for r = longer. j ; 
2, Multiple Conversion Methods = — See -10" we a neg ee eee 
Greenhall? at 10 MHz is ~10" tion needed to tell which oscillator 


is high\low in frequency; dead time 
often associated with measurements. 


Wide pelea see input allows a Using best available equipment, 


P ; -10" (vor of signals; simple to 
3. Time-Difference Method ~100 ps -20 ps. -10% salen MHz pet ambiguity almost aoa passin tenia instabilities 
at 10 MHz is ~10" My problem; measures time, time sta- for 7 less than several seconds, 
bility, frequency, and frequency hence is often limited to long-term 
stability. measurements. 


No dead time; may choose sample More complex than other methods, 
time (1 ms to as large as desired); and hence more susceptible to ex- 


a. Dual-Mixer -107/(v4s) oscillators may be at zero beat signal pickup; 
Time-Difference Method -100 ps_—=5 ps ~10% wc Marta: SStverenty iaeteareansen Daacwldsh Inopi ths pee rerashay Ae 
at 10 MHz is ~10°"/; easily changed, measures time, the beat period, e.g, 200 ns at 
time stability, frequency, and fre- = 5 MHz. 
quency stability. 


(Accuracy of the measurement cannot be better Lai the stability of the measu rence oscillal 
Th for @ measurement bandwidth of iene - feqeeney, Ts sane ni air alii si 


“This assumes use of a simple frequency counter. 
See C, Greenhall, 41st Annual Frequency Controt cakes 1987, pp. 126-129. 
‘The dash (——) means that the method is not generally appropriate for this quantity, 


Table 1. Guide to Selection of Measurement Methods, (continued) 


Measurement Time Time Frequi Frequi 
Method Accuracy* Stability heat Stability® Advantages Disadvantages 
(1 day) (7) 
TH. Homodyne Methods Particularly useful for measurement Generally no used for measurement 
of phase noise. of time, 
a aya EEE NSy 
1, Phase-Lock-Loop Methods Assure continuous quadrature of Care needed to assure that noise of 
signal and reference. interest is outside loop bandwidth. 


ec 


Useful for short-term time stability Long-term phase measurements 


Depends on -10"7/(vpr) analysis as well as spectrum analysis (beyond several seconds are not 
a. Loose-Phase-Lock Loop — — calibration which af'10 MHz and the detection of periodicity in practical. 
of varicap is 10°" /r noise as spectral lines; excellent 
sensitivity. 


i 


és Measurement noise typically less Need volinge controlled reference 
ds on 10" /(vpr) than oscillator instabilities for oscillator, frequency sensitivity is 
b, Tight-Phase-Lock Loop — —_— calibration which at 10 MHz 1 = 1s and longer, good measure- a function of varicap tuning curve, 
of varicap is ~10" wi ment system bandwidth control, hence not conducive to measuring 
dead time can be made small or absolute frequency differences, 
negligible. 


i 


Requires no reference oscillator. ‘Substantially less bandwidth than 


2. Discriminator Methods two-oscillator, homodyne methods, 
sensitivity low at low Fourier fre- 
quency. 

Depends on Depends on Requires no reference oscillator, Requires more difficult calibration 
characteris- characteris- very easy to set up and high in to obtain any accuracy over even 
a. Cavity Discriminator _ —_ tics of dis- tics of dis- sensitivity; practical at microwave modest range of Fourier frequencies; 
criminator criminator frequencies. accurate only for Fourier frequen- 
cies less than 0.1 x bandwidth, 
Requires no reference oscillator; Substantially less accurate than two- 
Depends on dynamic range set by properties oscillator, homodyne methods, cum- 
b. Delay Line == — — characteris- of delay line; practical at micro- __bersome sets of delay lines needed 
tics of delay wave frequencies. to cover much dynamic range; con- 
line siderable delay needed for measure- 


ments below 100 kHz from carrier, 
a Sooo 
“accuracy of the measurement cannot be better than the stability of the measurement. Accuracy is limited by the accuracy of the reference oscillator. 
is is for a measurement bandwidth of 10° Hz; v., = frequency, + = measurement lime, 
The dash (—) means that the method is not generally appropriate for this quantity. 
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Figure 1. 


Curve A. 


Curve B. 


Curve C. 


Curve D. 


Curve E. 


Curve F, 


F 


1 ms optical delay 


ixer systems 
A 
Si B 
multiplier high level mixer 


10’ 102 10° 10% 10° 10° 
Fourier Frequency (Hz) 


Comparison of nominal lower noise limits for different 
frequency-domain measurement methods. 


The noise limit (resolution), S@(f), of typical double-balanced 
mixer systems at carrier frequencies from 0.1 MHz to 26 GHz. 
The noise limit, S@(f), for a high-level mixer. 

The correlated component of S¢(f) between two channels 
using high-level mixers. 

The equivalent noise limit, S¢(f), of a 5 to 25 MHz frequency 
multiplier. 

Approximate phase noise limit for a typical delay-line system 
which uses a 500 ns delay line. 

Approximate phase noise limit for a delay-line system which 
achieves a 1 ms delay through encoding the signal on an 
optical carrier and transmitting it across a long optical fiber to 
a detector. 
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Table 1 organizes the measurement methods in the above manner giving performance 
limits, advantages and disadvantages for each. Figure 1 following the table provides limitations 
for phase noise measurements as a function of Fourier frequency. The reader is again reminded 
that the table is highly simplified giving nominal levels that can be achieved. Exceptions can be 
found to almost every entry. 


A.6 RELATIONSHIP OF THE MODIFIED ALLAN VARIANCE TO THE ALLAN VARIANCE 


In sorting through this set of papers and other published literature on the Allan Variance, 
we were stimulated to further consider the relationship between the modified Allan variance and 
the Allan variance. The ideas which were developed in this process have not been published, so 
we include them here. Paper D.6, "Characterization of Frequency Stability: Analysis of the 
Modified Allan Variance and Properties of Its Estimate," by Lesage and Ayi adds new insights 
and augments the Allan and Barnes paper (D.5), "A Modified Allan Variance with Increased 
Oscillator Characterization Ability." In this section we extend the ideas presented in these two 
papers and provide further clarification of the relationship between the two variances, both of 
which are sometimes referred to as two-sample variances. 

Figure 2 shows the ratio [mod 9,(1)/a, (1)} as a function of n, the number of time or 
phase samples averaged together to calculate mod 0,(T). This ratio is shown for power-law noise 
spectra (indexed by the value of a) running from P to f?. These corrected results have a some- 
what different shape for a = -1 than those presented in either paper D.5 or paper D.6, Further- 
more, this figure also shows the dependence on bandwidth for the case where @ = 1. For all 
other values of a shown, there is no dependence on bandwidth. Table 2 gives explicit values for 
the ratio as a function of n for low n as well as the asymptotic limit for large n. For a = 1, the 
asymptotic limit of the ratio is considerably simplified from that given in papers D.S and D.6. 
With these results it is possible to easily convert between mod o,(7) and o,(7) for any of the 
common power-law spectra. 

The information in figure 2 and table 2 was obtained directly from the basic definitions of 
9,(1) and mod o,(r) using numerical techniques. The results of the numerical calculations were 
checked against those obtained analytically by Allan and Barnes (D.5) and Lesage and Ayi (D.6). 
For a = 2, 0 and -2 the results agree exactly. For a = 1 and -1 the analytical expressions are 
really obtained as approximations. The numerical calculations are obviously more reliable. 
Details of our calculations can be found in a NIST report [1]. A useful integral expression (not 
commonly found in the literature) for modo;(r) is 


S. SNsinasf) , 
ae feces 


modo?(t) - 
Y 2 i? 
ze fF sin'(xt, a 


Figure 2 and table 2 show that, for the fractional frequency fluctuations, mod o,(7) 
always yields a lower value than o,(r). In the presence of frequency modulation (FM) noise 
with a > 0, the improvement is very significant for large n. This condition has been examined in 
detail by Bernier [2]. For white FM noise, a = 0, the optimum estimator for time interval 7 is 
to use the value of the times or phases separated by 1 to determine frequency. This is analo- 
gous to the algorithm for calculating ,(1) which yields the one-sigma uncertainty in the estimate 
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Table 2. 
number of time or phase samples averaged to obtain mod a(r = nt, where 1,) is the minimum sample time. 
w, is 2m times the measurement bandwidth f,, 


mod 0,(1) 


ox(1) 


Ratio of mod o3(7) to o;(1) versus n for common power-law noise types S,(f) = h,f*. nis the 


1 1.000 
2 0.859 
x 0.840 
4 0.831 
5 0.830 
6 0.828 
7? 0.827 
8 0.627 
10 «(0,626 
14 0.826 
20 0.825 
30 0.825 
50 0.825 
100 0.825 
Limic 0.825 
10 
5 
2 
- 
= ot 
= 0. 


Figure 2. 


sooo soeseoeose seco 


000 1.000 
738 0.616 
701 0.551 
681 0,530 
684 0.517 
681 0.514 
679 0.507 
678 0.506 
677 0.504 
675 0.502 
675 0.501 
675 0.500 
675 0.500 
675 0.500 
675 0,500 
2 
xa 
y 


5 10 


1.000 1.000 1.000 1.000 1.000 
0.568 0.543 0.525 0.5046 0.500 
0.481 0.418 0.384 0.355 0.330 
0.405 0.359 0.317 0.284 0.250 
0. 386 0.324 0.279 0.241 0.200 
0.349 0.301 0.251 0.214 0.167 
0.343 0.283 0.235 0.195 0.143 
0.319 0.271 0.219 0.180 0.125 
0.299 0.253 0.203 0.160 0.100 
0.274 0.230 0.179 0.137 0.0714 
0.253 0.210 0.163 0.119 0.0500 
0.233 0.194 0.148 0.106 0.0333 
0.210 0.176 0.134 0.0938 0.0200 
0.186 0.159 0.121 0.0837 0.0100 
is 3.37 ) = A/n 
T.04 +3 Inayr 
VS. T= nT) 
0.825 
0.675 
0.50 


337 
1.04 +3 In amt 


S=h fe 


2 5 100 2 5 1000 


n, Number of Samples Averaged 


: 2 F é 
Ratio of mod o;(T) to o3(7) as a function of the number of time samples averaged 
together to calculate either variance. 


of the frequency measured in this manner over the interval t. The estimate of frequency, 
obtained by averaging the phase or time data, is degraded by about 10 percent from that ob- 
tained by using just the end points [3]. This is analogous to the algorithm for calculating mod 
o,(17) which, in this case, underestimates the uncertainty in measuring frequency by /2. For 
white phase modulation (PM) noise, a = 2, the optimum estimator for frequency is obtained by 
averaging the time or phase data over the interval 7. This is analogous to the algorithm for 
calculating mod o,(T) which yields the one-sigma uncertainty in the estimate for frequency 
measured in this manner, This estimate for frequency is /n better than that provided by o,(7). 

Based on these considerations, it is our opinion that mod 9,(r) can be profitably used 
much more often than it is now. The presence of significant high-frequency FM or PM noise in 
the measurement system, in an oscillator, or in an oscillator slaved to a frequency reference, is 
very common. The use of mod 9,(1) in such circumstances allows one to more quickly assess 
systematic errors and long-term frequency stability. In other words, a much more precise value 
for the frequency or the time of a signal (for a given measurement interval) can be derived using 
mod oT) when n is large. 

The primary reasons for using 0,(1) are that it is well known, it is simple to calculate, it 
is the most efficient estimator for FM noise (a@ < 0), and it has a unique value for all r. The 
advantages of mod 9,(7) are cited in the above paragraph. There are some situations where a 
study of both o,(r) and mod o,(1) can be even more revealing than either one. The disadvan- 
tages of using mod o,(r) are that it is more complex to calculate and thus requires more com- 
puter time and it has not been commonly used in the literature, so interpretation of the results is 
more difficult to reconcile with published information. Another concern sometimes raised is that 
mod 9,(7) does not have a unique value in regions dominated by FM noise (a 20). With 
rapidly increasing computer speeds, the computational disadvantage is disappearing The correct- 
ed and expanded information presented in figure 2 and table 2 addresses the concern about 
uniqueness. 

The primary disadvantage of using o,(1) is that the results can be too conservative. That 
is, if the level of high-frequency FM noise is high, then the results are biased high, and it can 
take much longer (often orders of magnitude longer) to characterize the underlying low-frequen- 
cy performance of the signal under test. 
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PROPERTIES OF SIGNAL SOURCES ANO 
MEASUREMENT METHODS 


D. A. Howe, 0. W, Allan, and J. A. Barnes 


Time and Frequency Division 
National Bureau of Standards 
Boulder, Colorado 80303 


Summary 

This paper is a review of frequency stability 
measurement techniques and of noise properties of 
frequency sources. 

First, a historical development of the useful- 
ness of spectrum analysis and time domain measure~ 
ments will be presented, Then the rationale will 
be stated for the use of the two-sample (Allan) 
variance rather than the classical variance. 
Next, a range of measurement procedures will be 
outlined with the trade-offs given for the various 
techniques employed. Methods of interpreting the 
measurement results will be give In particular, 
the five commonly used noi 
flicker PM, white FM, flicker FM, 
FM) and their causes will be discussed. Methods 
of characterizing systematics will also be given. 
Confidence intervals on the various measures will 
be discussed. In addition, we will point out 
@ethods of improving this confidence interval for 
a fixed number of data points. 

Topics will be treated in conceptual detail. 
Only light (fundamental) mathematical treatment 
will be given. 

Although traditional concepts will be de- 
tailed, two new topics will be introduced fn this 
paper: (1) accuracy limitations of digital and 
computer-based analysis and (2) optimizing the 
results froma fixed set of input data. 

The final section will be devoted to funda- 
mental (physical) causes of noise in commonly used 
frequency standards. Also transforms from time to 
frequency domain and vice-versa will be given. 


Key Words. Frequency stability; Oscillator noise 
modeling; Power law spectrum; Time-domain st 

bility; Frequency-domain stability; White noise; 
Flicker noise. 


Introduction 

Precision oscillators play an important role 
in nigh speed communications, navigation, space 
tracking, deep space probes and in numarous other 
important applications. In this paper, we will 
review some precision methods of measuring the 
frequency and frequency stability of precision 
oscillators. Development of topics does not rely 
heavily on mathematics. The equipment and set-up 
for stability measurements are outlined. Examples 
and typical results are presented. Physical 


interpretations of common noise processes are 
discussed. A table is provided by which typical 
frequency domain stability characteristics may be 
translated to time domain stability characteristics 
and vice-versa. 


1. THE SINE WAVE AND STABILITY 

A sine wave signal generator produces @ 
voltage that changes in time in a sinusoidal way 
as shown in figure 1.1. The signal is an oscil- 
lating signal because the sine wave repeats itself. 
A cycle of the oscillation {s produced in one 
period "T". The phase is the angle “o" within a 
cycle corresonding to a particular time “t". 


FIGURE 1.1 
It is convenient for us to express angles in 
radians rather than fn units of degrees, and 
positive zero-crossings will occur at even sul- 


tiples of n-radians. The frequency “v" is the 
number of cycles in one second, which is the 
reciprocal of period (seconds per cycle). The 
expression describing the voltage "V" out of a 
sine wave signal generator is given by V(t) = %y 
sin [0(t)] where ‘py is the peak voltage amplitude. 
Equivalent expressions are 


t 
v(t) = Vpsin @ ') 
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and 


V(t) = ¥, sin (2nvt). 


Pp 
Consider figure 1.2. Let's assume tnat the maximum 
value of "V" equals 1, hence BN 21. We say 
that the voltage "V(t)" is normalized to unity. 
If we know the frequency of a signal and if the 
signal is a sine wave, then we can determine the 
incremental change in the period “T" (denoted by 
Bt) at a particular angle of phase, 


FIGURE 1.2 

Note that no matter now big or small at may be, we 
Can determine AV. Let us look at this from another 
point of view. Suppose we can measure SV and At. 
From this, there is a sine wave at a unique minimum 
frequency corresponding to the given SV and dt. 
For infinitesimally small At, this frequency is 
called the i us frequency at this t. The 
smaller the interval At, the better the approxi- 
mation of instantaneous frequency at t. 

When we speak of oscillators and the signals 
they produce, we recognize that an oscillator has 
some nominal frequency at which it operates. The 
“frequency stability” of an oscillator is a ters 
used to characterize the frequency fluctuations of 
the oscillator signal. There is no formal defini- 
tion for “frequency stability". However, one 
usually refers to frequency stability when com 
paring one oscillator with another, As we shall 


see later, we can define particular aspects of an 
oscillator's output then draw conclusions about 
its relative frequency stability. In general 
terms, 


“Frequency stability is the degree to wnicn 
an oscillating signal produces the same value 
of frequency for any fnterv. 
a specified period of ti 


. dt, througnout 


Let's examine the two waveforms shown in 
figure 1.3. Frequency stability depends on the 
amount of time involved in a measurement. Of the 
two oscillating signals, it is evigent that "2" is 
more stable than "1" from time t, to t, assuming 
the horizontal scales are linear in time, 


FIGURE 1.3 
From time t, to t,, there may d@ some question as 
to which of the two signals is more stable, but 
it's clear that from time t, to t,, signal "1" is 
at a different frequency from that in interval t, 
to t,. 

If we want an oscillator to produce a parti- 
cular frequency Yor then we're correct in stating 
that if the oscillator signal frequency deviates 
from vy over any interval, this is a result of 
something which fs undesiraple. In the design of 
an oscillator, it is important to consider the 
sources of mechanisms which degrade the oscil- 
lator's frequency stability. All undesirable 
mechanisms cause rancom (noise) or systematic 
processes to exist along with the sine wave signal 
of the osci 
components at the output of a sine wave signal 


Jator. To account for the notse 
generator, we can express the output as 


V(t) = [Vp + e(8)] sin (2nvgt + o(t)], (2.1) 
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where Vy = nominal peak voltage amplitude, 
e(t) = deviation of amplitude from nominal, 
MF nominal fundamental frequency, 
o(t) = deviation of phase from nominal. 


Ideally “ec” and “o" snould equal zero for all 
time. However, in the real world there are no 
perfect oscillators. To determine the extent of 
the noise components "ec" and “o", we shal) turn 
our attention to measurement techniques. 


The typical precision oscillator, of course, 
has a very stable sinusoidal voltage output with a 
frequency v and a period of oscillation T, which 
is the reciprocal of the frequency (v = 1/T). One 
goal is to measure the frequency and/or the fre- 
quency stability of the sinusoid. Instability is 
actually measured, but with little confusion it is 
often called stability in tne literature. Natur- 
ally, fluctuations {in frequency correspond to 
fluctuations in the period. Almost al! frequency 
measurements, witn very few exceptions, are mea~ 
surements of phase or of the period fluctuations 
in an oscillator, not of frequency, even thougn 
the frequency may be the readout. As an example 
most frequency counters sense the zero (or near 


iro) crossing of the sinusoidal voltage, which is 
the point at which tne voltage is the most sensi- 
tive to phase fluctuations. 

One must also realize that any frequency 
measurement involves two oscillators. In some 
instances, one oscillator is in the counter. It 
is impossiple to purely measure only one oscil- 
lator. In some instances one oscillator may de 
tnough better than tne other that the fluctuations 
measured may be considered essentially those of 
the latter. However, in general because frequency 
measurements are always dual, it is useful to 
define: 


breed? 
y (tye tt 2) 


as the fractional frequency difference or deviation 
of oscillator one, v,, with respect to a reference 
oscillator Vy divided by the nominal frequency Yo: 
Now, y(t) {8 a dimensionless quantity and useful 


im describing oscillator and clock performance; 
e.g., the time deviation, x(t), of an oscillator 
over a period of time t, is simply given by: 


t 
x(t) = J y(t" dat’ (1.3) 
° 


Since it is impossible to measure instantaneous 
frequency, any frequency or fractional frequency 
measurement always involves some sample time, St 
or “t"=-some time window througn which the oscil- 
lators are observed; whether it's a picosecond, a 
second, or a day, there is always some sample 
time. So when determining a fractional frequency, 
y(t), in fact wnat is happening is that the time 
deviation is being measured say starting at some 
time t and again at a later time, t +t. The 
difference in these two time deviations, divided 
by t gives the average fractional frequency over 
that period t: 


F(r) = ME t= x(t) (1.4) 


t 


Tau, t, may be called the sample time or averaging 
time; @.g., it may be determined by the gate time 
of a counter 

What happens in many cases is that one samples 
a number of cycles of an oscillation during the 
preset gate time of a counter; after the gate time 
has elapsed, the counter latches the value of the 
number of cycles so that it can be read out, 
printed, or stored in some other way. Then there 
{8 a delay time for such processing of the data 
before the counter arms and starts again on the 
next cycle of the oscillation. Ouring the delay 
time (or process time), information is lost. We 
have chosen to call it dead time and in some 
instances it becomes a problem. Unfortunately for 
data processing in typical oscillators the effects 
of dead time often hurt most when it is the hardest 
to avoid. In other words, for times that are 
short compared to a second when ft is very dif- 
ficult to avoid dead time, that is usually where 
dead time can make a significant difference in the 
data analysis. Typically for many oscillators, if 
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WETEROOYNE FREQUENCY 
MEASUREMENT METHOD 


the sample time is long compared to a second, the 
dead time makes little difference in the cata 
analysis, unless it is excessive.) New equipsent 
or techniques are now available which contribute 
zero or negligible dead time.” 

In reality, of course, the sinusoidal output 
of an oscillator is not pure, but it contains 
noise fluctuations as well. This section deals 


with the measurement of these fluctuations to 
determine the quality of a precision signal source. 

We will describe five different methods of 
measuring the frequency fluctuations in precision 
oscillators. 


1,1 Common Methods of Measuring Frequency Sta- 
dility 


A. Beat frequency method 
The first system is ca 


da heterodyne 


frequency measuring methoad or deat frequency 
method. The signal from two independent oscil- 
Vators are fed into the two ports of a double 
balanced mixer as illustrated in figure 1.4. 


FIGURE 1.4 


The difference frequency or the beat frequency, 
Vp» 18 obtained as the output of a low pass filter 
which follows the mixer. This beat frequency is 
then amplified and fed to a frequency counter and 
printer or to some recording device. The frac- 
tional frequency is obtained by dividing v, by the 
nominal carrier frequency 9° This system has 
excellent precision; one can measure essentially 
all state-of-the-art oscillators. 


8. Dual _mixer time difference (OTMD) system 


This system snows some significant promise and 
has just begun to de exploited. A plock diagram is 
shown is figure 1.5. 
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FIGURE 1.5 
To preface the remarks on tne OMTO, it should de 
mentioned that if the time or the time fluctua~ 
tions can be measured directly, an advantage is 
obtained over just 


suring the frequency. The 
reason is that one can calculate the frequency 
from the time without dead time as well as know 
the time behavior. The reason, in the past, that 
frequency has not been inferred from the time (for 
sample times of the order of several seconds and 
shorter) is that the time difference between a 
pair of oscillators operating as clocks could not 


be measured with sufficient precision (commercially 
the best that is available is 10-4! seconds). The 
system described in this section demonstrates a 
precision of 10-1? seconds. Such precision opens 
the door to making time measurements as well as 
frequency and frequency stability seasuements for 
sample times as short as a few milliseconds ang 
longer, all without dead time. 

In figure 1.5, oscillator 1 could be con- 
sidered under test and oscillator 2 could be 
considered the reference oscillator. These signals 
go to the ports of a pair of double balanced 
mixers. Another oscillator with separate symmetric 
buffered outputs is fed to the remaining other 
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ports of the pair of double balanced mixers. This 
common oscillator's frequency is offset by a 
desired amount from the other two oscillators. 
Then two different beat frequencies come out of 
the two mixers as shown. These two beat frequen- 
cies wil) be out of phase by an amount proportional 
to the time difference between oscillator 1 and 
2—excluding the differential phase snift tnat may 
be inserted. Further, the beat frequencies differ 
in frequency by an amount equal to the frequency 
difference between oscillators 1 and 2. 

This measurement technique is very useful 
where one has oscillator 1 and oscillator 2 on the 
same frequency. This is typical for atomic stan- 
dards (cesium, rubidium, and hydrogen freauency 
standards). 

Illustrated at the bottom of figure 1.5 is 
what might represent the deat frequencies out of 
the two mixers. A phase shifter may be inserted 
as illustrated to adjust the phase so that the two 
beat rates are nominally in pha: this adjustment 
sets up the nice condition that the noise of the 
common oscillator tends to cancel (for certain 


types of noise) wnen the time difference is deter- 
minea. After amplifying these beat signals, the 
start port of a time interval counter is triggered 
with the positive zero crossing of one beat and 
the stop port with the positive zero crossing of 
the otner beat. Taking the time difference be- 
tween the zero crossings of these beat frequencies, 
one measures the time difference between osci)lator 
Land oscillator 2, but with a precision which has 
Deen amplified by the ratio of the carrier fre- 
quency to the beat frequency (over that normally 
achievable with this same time interval counter). 
The time difference x(i) for the i‘” measurement 
between oscillators 1 and 2 is given by eq (1.5). 


atc o k 

xi) = AD. ok (1.5) 
Tp’ 0 (Yo 

wnere at(i) fs the i*" time difference as read on 


the counter, t, is the beat period, v, is the 
nominal carrier frequency, @ is the phase delay in 
radians added to the signal of oscillator 1, and k 


is an integer to be determined in order to remove 


the cycle ambiguity. It is only important to know 
k if the absolute time difference is desired; for 
frequency and frequency stability measurements and 
for time fluctuation measurements, k may be assumed 
zero unless one goes through a cycle auring a set 
of measurements. The fractional frequency can be 
derived in the normal way from the time fluctua 
tions. 


(oi, 0) = ¥6h. 1D 


Yo 


x(i_+ p) - xi) (2.6) 
St(i_+ 2) = atti) 
tS ¥, 


b “o 


20, 0F 


In eqs (1.5) and (1.6), assumptions are made 
that the transfer (or common) oscillator is set at 
a lower frequency than oscillators 1 and 2, and 
that the voltage zero crossing of the beat v, > v, 
starts and that v, > v. stops the time interval 
counter. The fractional frequency difference say 


de averaged over any integer multiple of t,: 


Yy.24 ty) = ee ea (1.7) 


where m is any positive integer. If needed, ty 
can be made to be very small by having very high 
beat frequencies. The transfer (or common) oscil- 
lator may be replaced with a low phase-noise 
frequency synthesizer, whicn derives its basic 
reference frequency from oscillator 2. In this 
set-up the nominal beat frequencies are simply 
given by the amount that the output frequency of 
the synthesizer is offset from v,. Sample times 
as short as a few milliseconds are easiliy ob- 
tained. Logging the data at such a rate can be a 
problem without special equipment. The latest NBS 
time scale measurement system is based on the OMTD 
and is yielding an excellent cost benefit ratio. 


C. Loose phase lock loop method 
This first type of phase lock loop method is 


illustrated in figure 1.6. The signal from an 
oscillator under test is fed into one port of a 


TN-18 


mixer. The signal from a reference oscillator is 
fea into the other port of tnis mixer. The signals 
are in quadrature, that is, they are 90 degrees out 


FIGURE 1.6 
of phase so that the average voltage out of the 
mixer is nominally zero, and the instantaneous 
voltage fluctuations correspond to phase fluc- 
tuations rather than to amplituce fluctuations 
between the two signals. The mixer 


a key 
element in the system. The acvent of the Schottky 
barrier dioce was a significant breakthrougn in 
ing low noise orecision stapility measurements. 
The output of this mixer is fed through a low pass 
filter ana then amplified in a feedback loop, 
causing the voltage controlled oscillator (refer 
ence) to be phase locked to the test oscillator. 
The attack time of the loop is adjusted such that 
a very loose phase lock (long time constant) 


Condition exists. This is discussed later fn 
section VIII. 

The attack time fs the time it takes the 
Servo system to make 70% of {ts ultimate correction 
after being sligntly disturbed. The attack time 
is equal to L/mw,, where w, is the servo bandwidth. 
If tne attack time of the loop is about a second 
then the voltage fluctuations will be proportional 
to the phase fluctuations for sample times shorter 
than the attack time. Depending on the coeffi- 
cient of the tuning capacitor and the quality of 
the oscillators involved, the amplification used 
may vary significantly but may typically range 
from 40 to 80 GB via a good low noise amplifier. 
In turn this signal can be fed to a spectura 
analyzer to measure the Fourier components of the 
Dhase fluctuations. This system of frequency- 
Gomain analysis is discussed in sections VIII to X. 


It is of particular use for sample times shorter 
than one second (for Fourier frequencies greater 
than 1 Hz) im analyzing the characteristics of an 
oscillator. It is specifically very useful if one 
nas discrete side banas such as 60Hz or detailed 
structure in the spectrum. How to characterize 
precision oscillators using this technique wil] ce 
treated in detail later in section IX and XI. 

One may also take the output voltage from the 
above amplifier and feed it to an A/D converter 
This digital output becomes an extremely sensitive 
measure of the short term time or phase fluctua~ 
tions between the two oscillators. Precisions of 
the order of a picosecond are easily achievable, 


0. Tignt phase lock loop metnod 

The second type of pnase Jock loop metnog 
(snown in figure 1,7) is essentially tne same as 
tne first in figure 1.6 except tnat in this case 
the loop 1s in a tignt pnase lock condition; i.e., 
the attack time of the loop snould be of tne order 
of a few milliseconds. in such a case, tne pnase 
fluctuations are being integrated so tnat the 


voltage output is proportional to the frequency 


TIGHT PHASE-LOCK LOOP 
METHOD OF MEASURING 
FREQUENCY STABILITY 


FIGURE 1.7 
fluctuations between the two oscillators and is no 
longer proportional to the pnase fluctuations for 
sample times longer than the attack time of the 
Joop. A bias box is used to adjust the voltage on 
the varicap to a tuning point that is fairly 


linear and of a reasonable value. The voltage 
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fluctuations prior to tne bias box (biased sligntly 
away from zero) may be fed to a voltage to fre- 
quency converter which in turn is fed to a fre- 
quency counter where one may read out the frequency 
fluctuations with great amplification of the 
instabiliti between this pair of oscillators. 
The frequency counter data are logged with a data 
logging device. The coefficient of the varicap 
and the coefficient of the voltage to frequency 
converter are used to determine the fractional 


frequency fluctuations, y,, between the oscil- 
lators, where { denotes the i* measurement as 
shown in figure 1.7. [It fs not difficult to 
achieve a sensitivity of a part in 10!* per Hz 
resolution of tne frequency counter, so one has 
excellent precision capabilities witn tnis system. 


E. Time di fferenc hod 
The last measurement method we will illustrate 


is very commonly used, but typically does not have 
the measurement precision more readily available 
in the first four methods illustrated above. This 
method is called the time difference method, and 
is shown in figure 1.8. Because of the wide 
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FIGURE 1.8 
bandwidth needed to measure fast rise-time pulses, 
this method is limited in signal-to-noise ratio. 
However, some counters are commercially available 
allowing one to do signal averaging or to do 
precision rise-time comparison (precision of time 
difference measurements in the range of 10 ns to 
10 ps are now available). Such a method yields a 
direct measurement of x(t) without any translation, 


conversion, or multiplication factors. Caution 
should be exercised in using this technique even 
if adequate measurement precision fs available 
because it fs mot uncommon to have significant 
instabilities in the frequency dividers shown in 
figure 1.8--of the order of several nanoseconds. 
The technology exists to build better frequency 
dividers than are commonly available, but manufac- 
turers have not yet availed themselves of state-of- 
the-art techniques in a cost beneficial manner. A 
trick to by-pass divider problems is to feed the 
oscillator signals directly into the time interval 
counter and‘observe the zero voltage crossing into 
& well matched impedance. (In fact, in all of the 
above methods one needs to pay attention to impe- 
dance matcning, cable lengths and types, and con- 
nectors). The divided signal can be used to 
resolve cycle ambiguity of the carrier, otherwise 
the carrier phase at zero volts may be used as the 
time reference. The slope of the signal at zero 
volts is 2nV./t,, where rt, = 1/v, (the period of 
oscillation). For ‘y = 1 volt and a 5 MHz signal, 
tnis slope is 3m volts/ns, which is a very good 
sensitivity. 


TI. MEASUREMENT METHOOS COMPARISON 
When making measurements between a pair of 
frequency standards or clocks, it is desirable to 


have less noise {n the measurement system than the 
composite noise in the pair of standards being 
measured. This places stringent requirements on 
measurement systems as the state-of-the-art of 
precision frequency and time standards has advanced 
to its current level. As will be shown, perhaps 
one of the greatest areas of disparity between 
measurement system noise and the noise in current 
standards is in the area of time difference mea~ 
surements. Commercial] equipment can measure tine 
differences to at best 10-!!s, but the time fluc 
tuations second to second of state-of-the-art 
standards is as good as 10-*3s. 

The disparity is unfortunate because if time 
differences between two standards could be measured 
with adequate precision then one may also know the 
time fluctuations, the frequency differences, and 
the frequency fluctuations. In fact, one can set 
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up an interesting hierarchy of kinds of measurement 
Systems: 1) those that can measure time, x(t); 2) 
those that can measure changes in time or time 
fluctuations éx(t); 3) those that can measure 
frequency, v(y # (v-¥.)/¥Q)5 and 4) those that can 
measure changes in frequency or frequency fluctua- 
tions, 6v (dy = bv/v,). As depicted in table 2.1, 
if a measurement system is of status 1 in this 
hierarchy, e., it can measure time, then time 
fluctuations, frequency and frequency fluctuations 
can be deduced. However, if a measurement system 
is only capable of measuring time fluctuations 
(status 2 - table 2.1), then time cannot be de- 
duced, but frequency and frequency fluctuations 


can, If frequency is being measured (status 3 - 
table 2.1), then neither time nor time fluctuations 
May be Geduced witn ficelity because essentially 
al) commercial frequency measuring devices have 
“dead time” (technology is at a point where that 
is changing with fast data processing speeds that 
are now available) Dead time in a frequency 
measurement cestroys the opportunity of integrating 
the fractional frequency to get to “true” time 
fluctuations. Of course, if frequency can be 
measured, then trivially one may ceduce the fre- 
Finally, if a: system can 
only measure frequency fluctuations (status 4 - 


quency fluctuations. 


table 2.1), then neitner time, nor time fluctu: 


tions, nor frequency can be deduced from the data. 
If the frequency stability is the primary concern 
then one may be perfectly happy to employ such a 
measurement system, and similarly for the other 
statuses in this measurement nierarchy. Obviously, 
if &@ measurement method of Status 1 could be 
employed with state-of-the-art precision, this 
would provide the greatest flexibility in data 
processing. From section 1, the dual mixer time 
difference system is purported to be such a method. 
Table 2.2 is a comparison of these different 
measurement methods. The values entered are 
nominal; there may be unique situations where 
significant departures are observed. The time and 
frequency stabilities listed are the 
second to second rms values. The accuracies 
listed are taken in an absolute sense. The costs 
listed are nominal estimates in 1981 dollars. 


nominal 


Figure 2.1 is a diagram indicating the 


sample time regions over which the various methods 


FIGURE 2.1 
are most appropriately applied. The large diago- 
nally oriented area indicates the typical noise 
limits of the measurement technique (at particular 
values of sample time indicated on the horizontal 
scale). 


III. CHARACTERIZATION 

Given a set of data of the fractional fre- 
quency or time fluctuations between a pair of 
oscillators, it is useful to characterize these 
fluctuations with reasonable and tractable models 
of performance. In so doing for many kinds of 
oscillators, it is useful to consider the flucua~ 
tions as those that are random (may only be pre- 
Gicted statistically) and those that are non 
random (e.g. , systematics— those that are environ- 
mentally induced or those that have a causal 
effect that can be determined and in many cases 
can be predicted). 


3.1 Non-random Fluctuations 

Non-random fluctuations are usually the main 
cause of departure from “true” time or “true” 
frequency. 


If, for example, one has the values of the 
frequency over a period of time and a frequency 
offset from nominal is observed, one may calculate 
Girectly that the phase error will accumulate as a 
ramp. If the frequency values show some linear 
drift then the time fluctuations will depart as a 
Quadratic. In almost a}] oscillators, the above 


systematics, as they are sometimes called, are the 
primary cause of time and/or frequency departure. 
A useful approach to determine the value of the 
frequency offset is to calculate the simple mean 
of the set, or for determining the value of the 
frequency drift by calculating a linear least 
squares fit to the frequency. A least squares 
quadratic fit to the phase or to the time deriva- 
tive is typically not as efficient an estimator of 


the frequency drift for most oscillators. 


3.2 Random Fluctuations 

After calculating or estimating the systematic 
or non-random effects of a data set, these may de 
subtracted from the data leaving the residual 
random fluctuations. These can usually be best 
Characterized statistically. [t is often the case 
for precision oscillators that these random fluc~ 
tuations may be well modeled with power law spec- 
tral densities. This topic fs discussed later in 
sections VIII to X. We have 


Sy(f) = nf 0) 


where S (f) is the one-sided spectral density of 
the fractional frequency fluctuations, f fs the 
Fourier frequency at which the density is taken, 
h, 1s the intensity coefficient, and @ is a numer 
modeling the most appropriate power law for the 
Gata. It nas been shown? that in the time 
domain one can nicely represent a power law spec- 
tral density process using a well defined time- 
Gomwain stability measure, o (1), to be explained 
in the next section. For example, if one observes 
from a log o.?(rt) versus t diagram a particular 
slope (call it wy) over certain regions of sample 
time, t, this slope has a correspondence to a 
power law spectra] density or a set of the same 


with some amplitude coefficient h,. In particular, 
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pra -l for -3 <acl and ye-2 forlca 
Further a correspondence exists between h, and the 
coefficient for oy (t). These coefficients have 
been calculated and appear in section XI, The 
transformations for some of the more common power 
law spectral densities nave been tabulated making 
it quite easy to transform the frequency stability 


mod! 


ed in the time-domain over to the frequency 
domain and vice versa. Examples of some power-law 
spectra that have been simulated by computer are 
shown in figure 3.1. In descending order these 


POWER LAW SPECTRA 


FIGURE 3,1 
have been named white noise, flicker noise, random 
walk, and flicker walk (tne w in fig, 3.1 is 
angular Fourser frequency, w = 2nf). 

Once the noise cnaracteristics have been 
determined, one is often able to deduce whether 
the oscillators are performing properly or not and 
whether they are meeting either the design speci- 
fications or the manufacturers specifications. 
For example a cesium beam frequency standard or a 
rubidium gas cell frequency standard when working 
Properly snpould exnibdit wnite frequency noise, 
which is the same as random walk phase (or time) 
for tau values of the order of a few seconds to 
Several thousand seconds (see also sec. XI). 


IV. ANALYSIS OF TIME DOMAIN DATA 

Suppose mow that one is given the time or 
frequency fluctuations between a pair of precision 
oscillators measured, for example, by one of the 


techniques outlined in section I, and a stability 
analysis is desired. Let this comparison be 
depicted by figure 4.1. The minimum sample time 


is determined by the measurement system. If the 
time difference or the time fluctuations are 
available then the frequency or the fractional 
frequency fluctuations may be calculated from one 
period of sampling to the next over the data 
length as indiciated in figure 4.1. Suppose 
further there are M values of the fractional 
frequency y;- Now there are many ways to analyze 
these data. Historically, people have typically 
used the standara deviation equation shown in 
figure 4.1, O44 gey, (1). where y is the average 
frequency over the data set and is 
subtracted from each value of ay before squaring, 
summing and dividing by the number of values minus 


fractional 


one, (M=1), ana taking the square root to get the 
standard deviation. At NBS, we have studied what 
happens to the standard deviation when the data 
set may be characterized by power Jaw spectra 
which are more dispersive than classical white 
noise frequency fluctuations. In otner words, if 
the fluctuations are characterized by flicker 
noise or any other non-wnite-noise frequency 
deviations, what happens to the standard deviation 
for that data set? One can show that the standard 
deviation is a function of the number of data 
points in the set; it 18 also a function of the 
dead time and of the measurement system bandwidth. 
For example, using flicker noise frequency modula~ 
as the number of data points 
the standard deviation monotonically 
ses without limit. Some statistical seasures 
have been developed which do not depend upon the 
data length and whicn are readily usable for 
characterizing the random fluctuations in precision 
oscillators. An IEEE subcommittee on frequency 
stability has recommended what has come to be 
known as the “Allan variance” taken from the set 


tion as a model, 
increases, 


inert 


of useful variances developed, and an experimental 
estimation of the square root of the Allan vari- 
ance is shown as the bottom right equation in 
figure 4.1. This equation is very easy to imple- 
ment experimentally as one simply need add up the 
squares of the differences between adjacent values 
of y;, divide by the number of them and by two, and 
take the square root. One then has the quantity 
which the IEEE subcommittee has recommended for 
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specification of stability 
denoted by a(t). 


2y(2) -G Gtr) - went) *, 


where tte brackets denote infinite time 
average. In practice this is easily estimated 
from a Timite data set as follows: 


bs 


iz] 


jin the time domain— 


(4.1) 


He" 
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oy(t) = (Yen > 4? » (4.2) 


2(M-1) 


where the y, are the discrete frequency averages 
as illustrated in figure 4.1. 


FIGURE 4.1 


A simulated plot of the time fluctuations, x(t) 
between a pair of oscillators and of the corres- 
ponding fractional frequencies calculated from the 
time fluctuations each averaged over a sample time 
T. At the bottom are the equations for the stan- 
dard deviation (left) and for the time-domain 
measure of frequency stability as recommended by 
the ie Subcommittee on frequency stability 
(right). 


One would like to know how o (t) varies with 
the sample time, t. A simple trick that one can 
use that is very useful if there is no dead time, 
is to average the previous values for % and ¥2 
and call that a new oon averaged over 2t, similarly 
average the previous values for Y3 and y, and call 
that a new Y2 averaged over 2t etc., and finally 
apply the same equation as defore to get 9 (2t). 
One can repeat this process for other desired 
integer multiples of t and from the same data set 
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be able to generate values for o (mt) as a function 
of mt from which one may be able to infer a model 
for the process that is characteristic of this 
pair of oscillators. If one nas dead time in the 
measurements adjacent pairs cannot ve averaged in 
an unambiguous way to simply increase the sample 
time. One has to retake the data for each new 
sample time--often a very time consuming task. 
This is another instance where dead time can be a 
problem. 

How the classical variance (standard deviation 
Squared) depends on the number of samples 1s shown 
in figure 4.2. Plotted is the ratio of the stan- 
dard deviation squared for N samples to the stan- 
dard deviation squared for 2 samples; <o?(2,1)> is 
the same as the Allan variance, oyF(t). One can 
see the dependence of the standard deviation upon 
the number of samples for various kinds of power 


FIGURE 4.2 


The ratio of the time average of the standard 
deviation squared for N samples over the time 
age of a two sample standard deviation squared 
as a function of the number of smaples, N. The 
ratio is plotted for various power law spectral 
densities that commonly occur in precision oscil- 
lators. The figure illustrates one reason why the 
Standard deviation is not a convenient measure of 
frequency stability; f.e. it may be very important 
to specify how many data points are in a data set 
if you use the standard deviation. 


law spectral densities commonly encountered as 
reasonable models for many important precision 
oscillators. Note, oir) has the same value as 
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the classical variance for the classical noise 
case (white noise FM), One main point of figure 
4.2 is simply to show that with the increasing 
Gata length the standard deviation of the common 
classical 
kinds of noise processes 
encountered in most of the precision oscillators 
of interest. 

One may combine eq (1.4) and eq (4.1), which 


yields an equation for o,(t) in terms of the time 


variance is not well behaved for the 


that are very often 


difference or time deviation measurements. 


a,(t) -Gh (xCte2e) + ax(ter) + «ey? ‘ 


(4.3) 


which for N discrete time readings may be estimated 
as, 


N=2 * 
pat O42 7 2X yq, + 4)? r 
(4.4) 


1 
oy) ® LTT 


where the ji denotes the number of the reading in 
the set of N and the nominal spacing between 
readings is t. If there is no dead time in the 
data and the original data were taken witn tne x's 
spaced by t,, in eq (4.4) to 
be any integer multiple of To ie,t8 LL 


we can pick ¢ 


4 


N= 2m 
1 - - 
oy(Mty) & | ER ZayarT? 2S iern ahh am 7)? 
(4.5) 
Equation (4.5) has some interesting consequences 
because of the efficient data usage in terms of 


the confidence of the estimate as will be explained 
in the next section. 


EXAMPLE: Find the Allan variance, 9,2(r), of the 
following sequence of fractional fre- 
quency fluctuation values y,, each value 
averaged over one second. 

Had 4.36 x 10-5 ¥5* 4,47 x 10-5 


Yq = 4.61 x 10-5 Yq = 3.96 x 10-8 
Yq * 3.19 x 10-5 Yq = 4.20 x 10-8 
Yq = 4.21 x 10-7 Yq = 3.08 x 10-8 


(assume no dead-time in measurement of averages) 


je of the fractional frequency 
fluctuation values is for one second, then the 
first variance calculation will be at r= ls. We 
are given M= 8 (eight values); therefore, the 
number of pairs in sequence is M-l=7. We have: 


stein esr 
7 oes sate 
ie 43 is 
ia La is 
Ar th tn 
in an ta 
4 on oa 
) Lar —H 
Med + 
J een)? = 452 20- 
Therefore, 
4.51 x 10-10 ae 
oy (18) 2 <0 = 3.2 x 10: 
and 


a(t) = oR(1s)]* = (3.2 x 10-174 # 5.6 x 10-8 


Using the same data, one can calculate the 
variance for t = 2s by averaging pairs of adjacent 
values and using these new averages as data values 
for the same procedure as above. For three second 
averages (t = 3s) take adjacent threesomes and 
find their averages and proceed in a similiar 
manner. More data must be acquired for longer 
averaging times. 

One sees that with large numbers of data 
values, it is helpful to use a computer or program- 
mable calculator. The confidence of the estimate 
on y(t) improves nominally as the square root of 
the number of data values used. In this example, 
M=8 and the confidence can be expressed as being 
no better the 1//S x 100% = 35%. This then is the 
allowable error in our estimate for the t = 1s 
average. The next section shows methods of com 
puting and improving the confidence interval. 
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V. CONFIDENCE OF THE ESTIMATE AND OVERLAPPING 
sampLes* 

One can imagine taking three phase or time 
measurements of one oscillator relative to another 
at equally spaced intervals of time. From this 
phase data one can obtain two, adjacent values of 
average frequency. From these two frequency mea- 
surements, one can Calculate a single sample Allan 
(or two-sample) variance (see fig. 5.1). Of 
course this variance does not have high precision 
or confidence since it is based on only one fre~ 
quency difference. 


t> 4 2 
ta4----F--- - 
a 


be 1 he 2 


FIGURE 5.1 

Statisticians have considered this problem of 
quantifying tne variability of quantities like the 
Allan Variance. Conceptually, one could imagine 
repeating the above experiment (of taking the 
three phase points and calculating the Allan 
Variance), many times and even calculating the 
distribution of the values. 

For the above cited experiment we know that 
the results are distributed like the statistician's 
chi-square distribution with one degree of freedom. 
That is, we know that for most common oscillators 
the first difference of the frequency is a normally 
distributed variable with the typical bell-shaped 
curve and zero mean, However, the square of a 
normally distributed variable is NOT normally 
distributed. That is easy to see since the square 
is always positive and the normal curve is com 
pletely symmetric and negative values are as 
likely as positive. The resulting distribution is 
called a chi-square distribution, and it has ONE 
“degree of freedom” since the distribution was 
obtained by considering the squares of individual 
(i.e., one independent sample), normally distri- 
buted varfables. 

In contrast, 
then we could calculate four consecutive frequency 
values, as in figure 5.2. We could then take the 


if we took five phase values, 


t+ 
AY 44---9---4----+---+ 
edn oo 4 == 
att ; 
be 1 the 2—vie— Spe 4 
He omar Fut bie saeco mR! 


| tems ew | 
b-22------es 
FIGURE 5.2 

first pair and calculate a sample Allan Variance, 
and we could calculate a second sample Allan 
Variance from the second pair (i.e., the third and 
fourth frequency measurements). The average of 
these two sample Allan Variances provides an 
improved estimate of the “true” Allan Variance, 
and we would expect it to nave a tignter confidence 
interval than in the previous example. This could 
be expressed with the aid of the chi-square distri- 
bution with TwO degrees of freedom. 

However, there is another option. We could 
also consider the sample Allan Variance obtained 
from the second and third frequency measurements. 
That is the middle sample variance. Now, however, 
we're in trouble because clearly this last sample 
Allan Variance is NOT independent of the other 
two. Indeed, it is made up of parts of each of 
the other two. This does NOT mean that we can't 


use it for improving our estimate of the “true” 
Allan Variance, but it does mean that we can't 
just assume that the new average of three sample 
Allan Variances is distributed as chi-square with 
three degrees of freedom. Indeed, we will en- 
counter chi-square distributions with fractional 
degrees of freedom. And as one might expect, the 
number of degrees of freedom wil] depend upon the 
underlying noise type, that is, white FM, flicker 
FM, or whatever. 

Before going on with this, it is of value to 
review some concepts of the chi-square distri- 
bution. Sample variances (like sample Allan 
Variances) are distributed according to the equa~ 
tion: 


52 


gn (3.1) 


where S? is the sample Allan Variance, x? is 
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chi-square, d.f. is the number of degrees of 
freedom (possibly mot an integer), and a2 {s the 
"true" 


Allan Variance we're all interested {n 


knowing--but = can estimate imperfectly. 
Chi-square is a random variable and its distri- 
bution nas been studied extensively. 


reason, 


only 


For some 
chi-square is defined so that d.f., the 
number of degrees of freedom, appears explicitly 
in eq (5.1). Stim}, x? is a (implicit) 
function of a.f., also. 

The probability density for the chi-square 
distribution is given by the relation 


df. 2 
ad 3 
) ae (5.2) 


1 
o(x?) = (2 
ot (55) 


i) 


where ($5) is the gamma function, defined by 
the integral 


2 
retype spat ha ax (5.3) 

Chi-square distributions are useful in deter~ 
mining specified confidence intervals for variances 
and standard deviations. is an example. 
Suppose we have a sample variance s? = 3.0 and we 
know that this variance has 10 degrees of freedom, 


Here 


(Just how we can know the degrees of freedom wil) 
be discussed shortly.) Suppose also tnat we want 
to know a range around our sample value of s? = 3,0 
which “probably” contains the true value, o7, The 
desired confidence is, say, 90%. That is, 10% of 
the time the true value will actually fall outside 
of the stated bounds. The usual way to proceed is 
to allocate 5% to the low end and S% to the hign 
end for errors, leaving our 90% in the middle. 
This fs arbitrary and a specific problem might 
dictate a different allocation. We now resort to 
tables of the chi-square distribution and find 
that for 10 degrees of freedom the 5% and 95% 
points correspond to: 


x7(.05) = 3.94 
for a.f. = 10 (5.4) 


x7(.95) = 18.3 
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Thus, with 90% probability the calculated sample 
variance, s?, satisfies the inequality: 
«52 
a9 EYE cies 


(8.5) 


and this inequality can be rearranged in the fora 


1.64 < a? ¢ 7.61 (5.6) 
or, taking square roots: 
1.28 <0 ¢ 2.76 (5.7) 


Now someone mignt object to the form of 
eq (5.7) since {it seems to be saying that 
the true sigma falls witnin two limits with 90% 


probability. Of course, this {s either true or 
not and fs not subject to a probabilistic inter- 
pretation. Actually eq (5.7) is based on 


the idea that the true sigma is not known and we 
estimate it with tne square root of a sample 
variance, s?*. This sample variance is a random 
variable and is properly the sudject of probabil- 
ity, and its value (which happened to be 3.0 in 
the example) will conform to eq (5.7) nine 
times out of ten, 

Typically, the sample variance is calculated 
from a data sample using tne relation: 


nN 
egy eB (8.8) 
a 


where it is implicitly assumed that the x,'S are 
random and uncorrelated ({.¢., white) and where x 
is the sample mean calculated from the same data 
set. If all of this is true, then s? is chi-square 
distributed and nas N-1 degrees of freedom. 

Thus, for the case of white x,, and a conven- 
tional sample variance (i.e., eq (5.8)), the 
number of degrees of freedom are given by the 
equation: 


af. = MeL (5.9) 
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The problem of interest here is to obtain the 
corresponding equations for Allan Variances using 
overlapping estimates on various types of noise 
(ice., white FM, flicker FM, etc.). 

Other authors (Lesage and Audoin, and 
Yoshimura) have considered the question of the 
variance of the Allan Variances without regard to 
the distributions. This is, of course, a closely 
related problem and use wil] be made of their 
results, These authors considered a more restric- 
tive set of overlapping estimates than will be 
considered here, however, 


VI. MAXIMAL USE OF THE DATA AND OETERMINATION OF 
THE DEGREES OF FREEDOM. 


6.1 Use of Data 

Consicer the case of two oscillators being 
compared in phase and exactly N values of the 
phase difference are obtained, Assume that the 
data are taken at equally spaced intervals, Tr) 
From these N phase values, one can obtain N-1 
consecutive values of average frequency and from 
these one can compute N-2 individual, sample Allan 
Variances (not all independent) for t= t,. These 
N-2 values can be averaged to obtain an estimate 
of the Allan Variance at t = t,. The variance of 
tnis variance has been calculated by the above 
cited authors. 

Using the same set of data, it is also possi-~ 
ble to estimate the Allan Variances for integer 
multiples of the base sampling interval, t = At. 


Now the possibilities for overlapping sample Allan 
Variances are even greater. For a phase data set 
of N points one can obtain exactly N-2n sample 
Allan Variances for t= My. Of course only a 
fraction of these are generally independent. 
Still the use of ALL of the data is well justified 
(see fig. 6.1). 

Consider the case of an experiment extending 
for several weeks in duration with the aim of 
getting estimates of the Allan Variance for tau 
to a week or more. As always the 
purpose is to estimate reliably the “true” Allan 
Variance as wel] as possible--that is, with as 
tight an uncertainty as possible. Thus one wants 


values equal 
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FIGURE 6.1 
to use the data as efficiently as possible since 
obtaining more data can be very expensive. The 


most efficient use {is to average al! possible 
sample Allan Variances of a given tau value that 
one can compute from the data. 

The problem comes in estimating how tight the 
confidence intervals really are—tnat is, in esti- 
mating the numer of cegrees of freedom. Clearly, 
if one estimates the confidence intervals pessi 
stically, 


then more data {is neeced to reach a 
specified tolerance, and that can be expensive. 
The other error of over-confidence in a question- 
Ideally, 
realistic confidence estimates for the 


most efficient use of the data, which is the 


able value can be even more expensive 
one has 


intent of this writing. 


6.2 Determining the Degrees of Freedom 
In principle, it should be possible to aeter- 


mine analytically tne equations corresponding to 
eq (5.9) for all cases of interest. Unfor- 
tunately the analysis becomes quite complicated. 
Exact computer algorithms were devised for the 
cases of white phase noise, white frequency modu- 
Tation and random walk FM. For the two flicker 
cases (j.e., flicker FM and PM) a completely 
empirical approach was used. Que to tne complexity 
of the computer programs, empirical 
Gevised for ail five noise types. 


fits were 
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The approach used is based on three equations 
relating to the chi-square distribution: 


as (6.1) 
Elx?] = 4.f. (6.2) 
Var(x?] = 2(4.f.) (6.3) 


where the expression E[x?] means the “expectation,” 
or average value of x, Var{x?] is the variance of 
x?, and d.f. is the number of degrees of freedom. 

A computer was .used to simulate phase data 
sets of some Jength, N, and then Allan Variances 
with t= nt, were calculated for all possible 
samples. 
1000 times using new simulated data sets of the 


This "experiment" was repeated at least 


same spectral type, and always of the same lengtn, 
N. Since the data were simulated on a computer, 
the “true” Allan Variance, o%, was known for many 
of the noise models and could be substituted into 
eq (6.1). From the 1000 vatues of s?/o?, distri- 
butions and sample variances were obtained. The 
“experimental” distributions were compared with 
theoretical distributions to verify that the 
observed distributions truely conformed to the 
chi-square distribution, 

The actual calculation of the degrees of 
freedom were made using the relation: 


at, = Ho (6.4) 
which can be deduced from eqs (6.1), (6.2), 


and (6.3). The Var(s?) was estimated by the 
sample variance of the 1000 values of the average 
Allan Variances, each obtained from a phase data 
set of length N. 

Of course this had to be repeated for various 
values of N and n, as well as for each of the five 
common noise types: white PM, flicker PM, white 
FM, flicker FM, and random walk FM. Fortunately, 
certain limiting values are known and these can be 
used as checks on the method. For example, when 
(N-1)/2=n, only one Allan Variance is obtained 
from each data set and one should get about one 
degree of freedom for eq (6.4), which was observed 
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in fact. Also for n=l the “experimental” condi- 
tions correspond to those used by Lesage and 
Audoin, and by Yoshimura. Indeed, the method also 
was tested by verifying that it gave results 
consistent with eq (5.9) when applied to the 
conventional sample variance. Thus, combining eq 
(6.4) with tne equations for the variance of tne 
Allan Varfances from Lesage and Audoin and 
Yoshimura, one obtains: 


White PM at, = BOER torn a4 
Flicker PM af. =? 

white FM ar, = eae (6.5) 
Flicker °M af, = HERE 

Random Walk FM 0d. f, = NZ 

for m@l. Unfortunately, their results are not 


totally consistent with each other. Where {ncon- 
sistency arose the value in best agreement with 
the “experimental” results was chosen. 

The empirical equations which were fit to the 
“experimental” data and the known values are 
summarized below: 


white PM af. = a, ieee 
Fiteker Hgts exp (in SEE yy L2artrowrny) 


(6.6) 
wit re aut, a [QED . 202d), ot 


with, tor mi 


TW gay for 22 


Random walk FM og.t, 3 M2 (CL —aninedsént 


The figures in Appendix I demonstrate the fit to 
the “experimental” data. 


Flicker FM af.a 
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It is appropriate to give some estimate of 
just how well these empirical equations approach 
the "true" values. The equations have approxi- 
mately (a few percent) the correct assymptotic 
behavior at n=l and n=(N-1)/2. In between, the 
values were tested (using the simulation results) 
over the range of NeS to #1025 for n=l to 
m=(N-1)/2 changing by octaves. In general, the 
fit was good to within a few percent. We must 
acknowledge that distributional problems with the 
random number generators can cause problems, 
although there were several known values which 
should have revealed these problems if they are 
Present. Also for three of the noise types the 
exact number of degrees of freedom were calculated 
for many values of N and n and compared with the 
"Monte Carlo" calculations, The results were all 
very good. 

Appendix [ presents the data in graphical 
form. All values are thought to be accurate to 
within one percent or better for the ¢: of 
white PM, white FM, and random walk FM. A larger 


tolerence should be allowed for the flicker cases. 


VIT. EXAMPLE OF TIME-DOMAIN SIGNAL PROCESSING AND 
ANALYSIS 
We will analyze in some detai] a commercial 
portable clock, Serial No. 102. This cesium was 
measured against another commercial cesium whose 
Stability was well documented and verified to be 
better than the one under test. Plotted in figure 


7.1 are the residual time deviations after removing 
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a mean frequency of 4.01 parts in 1029. Applying 
the methods described in section IV and section V, 
we generated tne or) diagram shown in figure 
7.2. 
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FIGURE 7.2 
One observes that the last two points are propor 
tional to 7) and one {s suspicious of a signifi- 
cant frequency drift. 

If one calculates the drift knowing that 
o,(t) is equal to the arift times 55 a drift of 
1.22 x 10-** per day is obtained. A linear least 
squares to the frequency was removed and sections 
IV and V were applied again. The linear least 
squares fit showed a drift of 1.23 x 10-!* per 
day, which is in excellent agreement with the 
previous calculated value obtained from o (tr). 
Typically, the linear least squares will give a 
much better estimate of the linear frequency drift 
than will the estimate from y(t) being propor- 
tional tor}, 

Figure 7.3 gives the plot of the time resid- 
uals after removing the linear least squares and 
figure 7.4 is the corresponding o.(t) vs. t dia~ 
gram. From the 33 days of data, we have used the 
90% confidence interval to bracket the stability 
estimates and one sees a reasonable fit corres- 
ponding to white noise frequency modulation at a 
level of 4.4.x 10-11 ¢%, This seemed excessive 
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in terms of the typical performance of this par- 
ticular cesium and in as much as we were doing 
some other testing within the environment, such as 
working on power supplies and charging and dis- 
charging batteries, we did some later tests. 
Figure 7.5 is a plot of oft) after the standard 
had Deen left alone in a quiet environment and nad 
been allowed to age for about a week. One ob- 
serves that the white noise frequency modulation 
level is gore than a factor of 4 improved over the 
Previous data. This led us to do some studies on 
the effects of the power supply on the cesium fre- 
quency as one is charging and discharging bat- 
teries, which proved to be significant. One 
notices in figure 7.4 that the o (t) values plotted 
are consistent within the error bars with flicker 
noise frequency modulation. This is more typical 
of the kind of noise one would expect due to such 
environmental perturbations as discussed above. 

Careful time- and/or frequency-domain analy- 
ses can lead to significant insights into problems 
and their solutions and is highly recommended by 
the authors. The frequency-domain techniques wil! 
be next approached. 


VIII. SPECTRUM ANALYSIS 
Another method of characterizing the noise in 


4 signal source is by means of spectrum analysis. 
To understand this approach, let's examine the 
waveform shown in figure 8.1. 


FIGURE 8.1 
Here we have a sine wave which is perturbed 
for short instances by noise. Some loosely refer 
to these types of noises as “glitches”. The 
waveform has a nomina) frequency over one cycle 
wnich we'll call "vo" (vy = #). At times, noise 
causes the instantaneous frequency to differ 
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markedly from the nominal frequency. If a pure 
sine wave signal of frequency vy is subtracted 
from this waveform, the remainder is the sum of 
the noise components. These components are of a 
variety of frequencies and the sum of their ampli- 
tudes is nearly zero except for the intervals 
during each glitch when their amplitudes somen- 
tarily reinforce each other. This fs shown graph- 
ically in figure 8.2. 


FIGURE 8.2 
One can plot a graph showing rms power vs. 


frequency for a given signal. This kind of plot 
is called the power spectrum. For the waveform of 
figure 8.1 the power spectrum will have a high 
value at vy and will nave lower values for the 
signals produced by the glitches. Closer analysis 
reveals that there is a recognizable, somewhat 
constant repetition rate associated with the 
glitches. In fact, we can deduce that there is a 
significant amount of power {in another signal 
whose period is the period of the glitches as 
shown in figure 6.2. Let's call tne frequency of 
the glitches %s- Since this fs the case, we will 
observe a noticeable amount of power in the spec- 
trum atv, with an amplitude which is related to 
the characteristics of the glitches. The power 
spectrum shown in figure 8.3 nas tnis feature. A 


predominant % component has been depicted, but 
other harmonics also exist. 
SPECTRAL DENSITY 
ef 
rR 
1 
0 Yo | 
rE 
FIGURE 8.3 
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Some noise will cause the instantaneous fre- 
quency to “jitter around vy, with probability of 
being higher or lower than vy. We thus usually 
find a “pedestal” associated with v, as shown in 
figure 8.4. 


FIGURE 8.4 
The process of breaking down a signal into 
all of its 


various components of frequency is 


callec Fourier exoansion (see sec. xX). In 
other words, the addition of all tne frequency 


components, called Fourier frequency components, 
produces the original signal The value of a 
Fourier frequency is the difference between the 
frequency component and the fundamental frequency. 
The power spectrum can be normalized to unity such 
that the total area under the curve equals one. 
The power spectrum normalized in tnis way is the 


power spectral density. 


The power spectrum, often called the RF 
spectrum, of V(t) is very useful in many appli- 
cations. Unfortunately, if one is given the RF 


spectrum, it is impossible to determine whether 
the power at different Fourier frequencies is a 
result of amplitude fluctuations “e(t)" or phase 
fluctuations "9(t). The RF spectrum can be separ- 
ated into two independent spectra, one being the 
spectral density of "z(t)" often called the AM 
Power spectral density and the other being tne 
spectral density of “9(t)". 

For the purposes here, the phase-fluctuation 
Components are the ones of interest. The spectral 
Gensity of phase fluctuations is denoted by $,(f) 
where "f" is Fourier frequency. for the fre- 
quently encountered case where the AM power spec- 
tral density is negligibly small and the total 
Modulation of the phase fluctuations is small 
(mean-square value is much less than one rad?), 
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the RF spectrum nas approximately the same shape 
as the pnase spectral density. However, a main 
difference in the representation is that the RF 
spectrum includes the fundamental signal (car- 
rier), and the phase spectral density does not. 
Another major difference is that the RF spectrum 
is @ power spectral density and is measured in 
units of watts/hertz, The phase spectral density 
involves no “power” measurement of the electrical 
signal. The units are radians?/hertz. It is 
tempting to think of 5,(f) as a “power” spectral 
density because in practice it is measured by 
passing V(t) through a phase detector and measuring 
the detector's output power spectrum. The measure- 
ment technique makes use of the relation that for 
small deviations (69 << 1 radian), 


2 

v (f) 
S.(f) (4°) 
. s 


Views?) is the root-mean-square noise voltage 


(8.3) 


whe! 


per JAz at a Fourier frequency "f", and V, is the 
sensitivity (volts per radian) at the phase quadra~ 
ture output of a phase detector wnich is comparing 
the two oscillators. In the next section, we will 
look at a scheme for directly measuring $,(f). 

One question we might ask is, “How do fre- 
quency changes to phase fluctuations?” 
After al) it's tne frequency stability of an 
oscillator that is a major consideration in many 
The frequency fs equal to a rate of 
This tells us 
that fluctuations in an oscillator’s output fre- 


relate 


applications. 
change in the phase of a sine wa 


quency are related to phase fluctuations since we 
Must change the rate of “@(t)" to accomplish a 
shift in “v(t)", the frequency at time t. A rate 
of change of total "#(t)" is denoted by "oy(ty". 
We have then 


ar(t) = oy(t) (8.4) 


The dot denotes the mathematical operation of 
differentiation on the function ¢, with respect to 


its independent variable t.* From eq (8.4) 


= As an analogy, the same operation relates the 


position of an object with its velocity. 
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and eq (1.1) we get 
2ru(t) = O5(t) = Bevy > O(t) 


Rearranging, we have 


Bro(t) > avg = a(t) 


v(t) = V9 Be 


The quantity v(t) - Yq can be more conveniently 
denoted as Sv(t), a change in frequency at time t. 
Equation (8.5) tells us that if.we differentia 
the phase fluctuations o(t) and divide by 21, we 
will have calculated the frequency fluctuation 
Sv(t). Rather than specifying a frequency fluc~ 
tuation in terms of shift in frequency, it is 
useful to denote dv(t) with respect to the nominal 


frequency %- The quantity S20) is called the 


or 
(8.5) 


fractional frequency fluctuation"*™ at time t and 
is signified by the variable y(t). We have 


y(t) * ae : ig (8.6) 


The fractional frequency fluctuation y(t) is 
a dimensionless quantity. When talking about fre- 
quency stability, {ts appropriateness Decomes 
clearer {if we consider the following example. 
Suppose in two oscillators é6v(t) is consistently 
equal to + 1 Hz and we nave sampled this value for 
many times t. Are the two oscillators equal in 
their ability to produce their desired output 
frequencies? Not if one osciliator is operating 
at 10 Hz and the other at 10 MHz. In one case, 
the average value of the fractional frequency 
fluctuation is 1/10, and in the second case is 
1/10,000,000 or 1 10-7, The 10 MHz oscillator 
is then more precise. If frequencies are multi-~ 
plied or divided using ideal electronics, the 
fractional stability is not changed. 

In the frequency domain, we can measure the 
spectrum of frequency fluctuations y(t). The 


** Some international recommendations replace 
“fractional” by "normalized". 
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spectral density of frequency fluctuations is 
denoted by sycf) and fs obtained by passing the 
Signal from an oscillator through an ideal FM 
detector and performing spectral analysis on the 
resultant output voltage. S$ (f) has dimensions of 
(fractional frequency)?/Hz or Hz-+. Differentia~ 
tion of @(t) corresponds to multiplication by = 


in terms of spectral densities. Witn further cal- 


culation, one can derive that 


f 
s(t) = (=) ERG) (8.7) 


We will address ourselves primarily to 5,(9). that 
is, the spectral density of phase fluctuations. 
For noise-measurement purposes, S,(f) can de 
measured with a straightforward ly duplicated 
equipment set-up. Whether one measures phase or 
frequency spectral densities {s of minor importance 
since they bear a direct relationship. It is 
important, however, to make the distinction and to 
use eq (8.7) if necessary. 


8.1 The Loose Phase-Locked Loop 
Section I, 1.1, C described a method of 


measuring phase fluctuations between two phase- 
locked oscillators. Now we wil) detail the pro- 
cedure for measuring S,(f). 

Suppose we nave a noisy oscillator. We wish 
to measure the oscillator’s phase fluctuations 
relative to nominal phase. One can do this by 
phaselocking another oscillator (called the re- 
ference oscillator) to the test oscillator and 
mixing the two oscillator signals 90° out of phase 
(phase quadrature). This is shown schematically 
in figure 8.9. The two oscillators are at the 
same frequency in long term as guaranteed by the 
phase-lock loop (PLL). A low-pass filter (to 
filter the R.F. sum component) is used after the 
mixer since the difference (baseband) signal is 
the one of interest. By holding the two signals 
at a relative phase difference of 90°, short-ter= 
phase fluctuations between the test and reference 
oscillators will appear as voltage fluctuations 
out of the mixer. 


FIGURE 8,9 

if we can make the servo time 
then the PLL bandwidth as a 
filter will be smal}, This may be done by lowering 
the gain A, of the loop amplifier. We want to 
tra @ the phase modulation spectrum to base~ 


With a PLL, 
constant very long, 


banc spectrum so that it is easily measured on a 
spectrum with a PLL 
we must keeo in mind that the reference 


Tow frequency 
filter, 
oscillator snould be as good or better than the 
test oscillator. This is bdecause the output of 
the PLL represents the noise from both oscillators, 


analyzer. 


and if not properly chosen, the reference can nave 
noise masking the noise from the test oscillator 
Often, 
the same type and have, therefore, approximately 


the reference and test osci)lators are of 


the same noise. We can acquire a meaningful 
measurement by noting that the noise we measure is 
from two oscillators. Many times 2 good approxi- 
mation is to assume that the noise power is twice 
that which 
$,(1) is general notation depicting spectral den- 
A PLL filter output 


necessarily yields noise from two oscillators. 


is associated with one oscillator. 
sity on a per nertz basis. 
The output of the PLL filter at Fourier 
frequencies above the loop bandwidth is a voltage 
representing phase fluctuations between reference 
and test oscillator. It is necessary to make the 
time-constant of the loop long compared with the 
inverse of tne lowest Fourter frequency we wisn to 
That {s, t. > mag This means 
that if we want to measure S.(f) down to 1 Hz, the 
Toop time-constant must be greater than & se- 
conds. One can measure the time-constant by 
perturbing the loop (momentarily disconnecting the 
battery and noting the time it 
takes for the control voltage to reach 70% of its 
final value. 
be inserted 


measure. 


is convenient) 


The signal from the mixer can then 
into a spectrum analyzer. A preamp 
May be necessary before the spectrum analyzer, 


e Appendix Note # 3 
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The analyzer determines the mean square volts that 
pass through the analyzer's bandwidth centered 
around a pre-chosen Fourier frequency f. It is 
desireable to normalize results to a 1 Hz band 
width. Assuming white phase noise (white PM), 
this can be done by dividing the mean square 
voltage by the analyzer bandwiath in Hz. One may 
have to approximate for other noise processes. 
(The phase noise sideband levels will usually be 
indicated in rms 
analyzers.) 


volts-per-root-Hertz on most 


8.2 Equipment for Frequency Domain Stability 


Measurements 
(1) Low:notse mixer 
This should be a nigh quality, douple~ 
balanced type, dut single-ended types 
may be used. The oscillators should 
have well-buffered outputs to be able to 
isolate the coupling between the two 
input RF ports of the mixer. 
that are too good may be obtained if the 
two oscillators couple tightly via 
signal injection through the {nput 
ports. We want the PLL to control 
locking, One should read the specifi- 
cations in order to prevent exceeding 
the maximum allowable input power to the 
It is dest to operate near the 
maximum for best signal-to-noise out of 
the IF port of the mixer and, in some 
cases, it is possible to drive the mixer 
into saturation without burning out the 
device. 


a 
&— 4-8 — 
heal 
FIGURE 8.10 


(2) low-noise 0C lifter 
The amount of gain A needed in tne loop 
amplifier will depend on the amplitude 
of the mixer output and the degree of 


‘88 See Appendix Note #4 
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varactor contro] in the reference osci]- 
Jator. We may need only a small amount 
of gain to acquire lock. On the other 
and, it may be necessary to add as @uch 
as 80 dB of gain. Good low-noise 0C 
amplifiers are available from a number 
of sources, and with cascading stages of 
amplification, each contributing noise, 
it will be the noise of the first stage 
which will add most significantly to the 
moise being measured. If a suitable 
low-noise first-stage amplifier fs not 
readily available, a schematic of an 
amplifier with 40 dB of gain is shown in 
figure 8.11 which will serve nicely for 
the first stage. Amplifiers with very 
low equivalent input noise performance 
able from many manufac- 


are also av 
The response of the amplifier 
should be flat from OC to the highest 
Fourier frequency one wishes to measure. 
The loop time-constant is 


turers. 


inversely 
related to the gain A, and the determi- 


nation of A, is best le by experimen- 
1 


oe ois wm 
FIGURE 8.11 

Voltage-controlied reference quartz 
illator 
This oscillator should be a good one 
with specifications available on its 
frequency domain stability. The refer- 
ence should be no worse tnan the test 
oscillator. The varactor contro] snould 


See Appendix Note # 5 
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be sufficient to maintain phase-lock of 
the reference. In general, low quality 
test oscillators may have varactor 
contro! of as much as 1 x 10-® fractional 
frequency change per volt. Some provi- 
sion should be available on the reference 
oscillator for tuning the mean frequency 
over a frequency range that will enable 
phase-lock. Many factors enter into the 
choice of the reference oscillator, and 
often it is convenient to simply use two 
test oscillators phase-locked together. 
In this way, one can assume that the 
noise out of the PLL filter is no worse 
than 3 GB greater than the noise from 
each oscillator. If it is uncertain 
that both oscillators are contributing 
approximately equal noise, then one 
should perform measurements on three 
oscillators taking two at a time. The 
oscillator will 


noisierthan-average 
reveal itself. 


(4) Spectrum analyzer 

The signal analyzer typically should be 
capable of measuring the noise in rms 
volts in a narrow bandwidth from near 
1 Hz to the highest Fourier frequency 
of interest. This may be 50 kHz for 
carrier frequencies of 10 MHz or lower. 
For voltage measuring analyzers, it is 
typical to use units of “volts per Az”. 
The spectrum analyzer and any associated 
input amplifier will exhibit hign-fre- 
quency rolloff, The Fourier frequency 
at which the voltage has dropped by 3 dB 
is the measurement system bandwidth f,, 
or w, = 2nf,. This can be measured 
directly with a varfable signal gener- 
ator. 


Section X describes how analysis can be 
performed using a discrete fourier transform 
analyser. Expanding digital technology has sade 
the use of fast-fourier transform analysis affor- 
dable and compact. 


Rather than measure the spectral density of 
phase fluctuations between two oscillators, it is 
possible to measure the phase fluctuations intro- 
duced by a device such as an active filter or 
amplifier. Only a slignt modification of the 
existing PLL filter equipment set up is needed. 
The scheme is shown in figure 8.12. 


JUNPEA TO MEASURE LATRIMSIC NOISE OF SET-UP 


FIGURE 8.12 
Figure 8.12 is a differential phase noise 
measurement set-up. The outout of the reference 
oscillator is split so that part of the signal 


passes through the device under test. We want the 
two signals going to the mixer to be 90° out of 
phase, thus, phase fluctuations between the two 
input ports cause voltage fluctuations at the 
output. The voltage fluctuations then can be 
measured at frequencies on a 
spectrum analyzer, 

To estimate the noise inherent in the test 
set-up, one can in principle bypass the device 
under test and compensate for any change in amoli- 
tude and pnase at the mixer. The PLL filter 
technique must be converted to a differential 


various Fourier 


noise technique in order to measure inherent 


equipment noise, It is a good practice to 
e_system noise defo roceeding to mea~ 


surement of device noise. 


A frequency domain measurement 
shown schematically in figure 8.13. 


set-up is 
The component 


values for the low-pass filter out of the mixer 
are suitable for oscillators operating at around 
5 MHz. 

The active gain element (a) of the loop is a 
OC amplifier with flat frequency response. One 
may replace this element by an integrator to 
achieve high gain near OC and hence, maintain 
better lock of the reference oscillator in long 
tern. Otherwise long-term drift between the 
reference and test oscillators might require 
manual re-adjustment of the frequency of one or 
the other oscil Jator.® 


8.3 Proceaure ang le 
At the input to the spectrum analyzer, the 
voltage varies as tne phase fluctuations in short- 


Vag lth) ¥ 
5,(0) = = 


¥, is the phase sensitivity of the mixer in volts 
per radian. Using the previously described equip- 
ment set-up, ¥, can be measured by disconnecting 
the feedback loop to the varactor of the reference 
oscillator, The peak voltage swing is equa) to v, 
in units of volts/rad if the resultant beat note 
is a sine wave. This may mot be the case for 
state-of-the-art $,(f) measurements where one must 
drive the mixer very hard to achieve low mixer 
noise levels, Hence, the outout will not be a 
sine wave, and the volts/rad sensitivity must be 
estimated by the slew-rate (through zero volts) of 
the resultant square-wave out of the mixer/amp]i- 
fier. 

The value for tne measured 5,0) in decibels 
is given by: 


term 


VingVoltage at f 
Sy(4) = 20 Tog Vi full-scale o-detector voltage 


EXAMPLE: Given a PLL with two oscillators such 
that, at the mixer output: 


Pr 2 1 volt/rag 
¥ See Appendix Note # 6 
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Vems (45 Hz) = 100 nV per root hertz 


solve for $,(45 Hz). 


4 \2 .7\? 


= 10-38 rage 


Tn decibels, 


7 
$4(48 Hz) = 20 log 200. = 20 10g HE 


= 20 (+7) = 180 dB at 45 Hz 


In the example, note that the mean frequency 
of the oscillators in the PLL was not essential to 
computing S,(f). However, in the application of 
$,(f), the mean frequency vy is necessary informa~ 
tion, Along with an 5,(f). one should always 
attach v,. In the example above v, = 5 MHZ, so we 


‘0 
nave 


Sy (45 Hz) = 20-24 TAS ym 5 me. 
From eq (8.7), s(t) can be computed as 


8, 45 mn) = (pe) ioe 


Sy (45 Hz) = 82x 10-28 Hz-4, v= S$ MHz. 


1X. POWER-LAW NOISE PROCESSES 
Power-law noise processes are models of 


precision oscillator noise that produce a parti- 
cular slope on a spectral density plot. We often 
Classify these noise processes into one of five 
categori Far plots of (7), they are: 


1. Random walk FM (random walk of fre- 
quency), Sy plot goes down as 1/f*. 

2. Flicker FM (flicker of frequency), Sy 
plot goes down as 1/13. 

3. White FM (white of frequency), sy plot 
goes down as 1/f2. 

4. Flicker PM (flicker of phase), Sy plot 
goes down as 1/f. 

S. White PM (white of phase), S, plot is 
flat. 


Power law noise processes are characterized by 
their functional dependence on Fourier frequency. 
Equation 8.7 relates $,(f) to sy). the spectral 
density of frequency fluctuations. Translation of 
sy) to time-domain data a(t) for the five model 
noise processes is covered later in section XI. 

The spectral density plot of a typical oscil- 
Jator's output usually is a combination of dif- 
ferent power-law noise processes. It is very 
useful and meaningful to categorize the noise 
processes. The first job in evaluating a spectral 
density plot is to determine which type of noise 
exists for a particular range of Fourier fre- 
quencies. It is possible to have all five noise 
processes being generated from a single oscillator, 
but, in general, only two or three noise processes 
are dominant. Figure 9.1 is a graph of S,(f) 
showing the five noise processes on a log-log 


“scale. Figure 9.2 shows the spectral density of 
phase fluctuations for a typical high-quality 
oscillator. 

‘SPECTRAL DENSITY OF PHASE 

-” Vo = 5 MHz 


10? ro! 1? 1? votes 
wouaice racevcect (1) 
FIGURE 9.1 


Liceee Pm 


IL LCREE 


1? to! 1% to? volar 
Fovaee Fecgucact if) 
FIGURE 9.2 
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X, PITFALLS IN DIGITIZING THE DATA 

The advent and prolific use of digital com 
puters has changed the manner in which processing 
of analog signals takes place if a computer is 
used. This section addresses the most common 


problems in such analyses. 


10,1 Discrete-Continuous Processes 

Digital processing implies that data must be 
presented to a computer or other processor as an 
array of numbers whetner in a batch or in a time 
If the data are not already in this form 
(it usually fs not when considering frequency 
stability measurements), then it fs necessary to 
transform to this format by digitizing. Usually, 


series. 


the signal available for analysis is a voltage 
which varies with frequency or phase difference 
Detween two oscillators. 


10.2 Digitizing the Data 
Digitizing tne cata is tne process of conver- 


ting a continuous waveform into discrete numoers. 
The process {s completed in real time using an 
analog-to-digital converter (ADC). Three consid- 
erations in the AOC are of importance he! 


1. Conversion time 
2. Resolution (quantization uncertainty) 
3. Linearity 


An ADC “looks at" an incoming waveform at equi- 
spaced intervals of time T. Ideally, the output 
of the ADC is the waveform (denoted by y(t)) 
multiplied by a series of infinitely narrow 
sampling intervals of unit height as in figure 
10.1, We have att = T 

¥y0t) = y(t)6(t-T) = y(T)6(t-T) (0.1) 
where 6(t-T) is a delta function. If y(t) is 
continuous at t = nT and n= 0, 21, £2,..., then 


: 
Wg) = Ee y6ot) 6 (teat) 


(10.2) 
2 = integer 


The delta function respresentation of a sampled 
waveform eq (10.2) is useful wnen a subsequent 
continuous integration is performed using it.” 


FIGURE 10.1 

In ADC's, the input signal is sampled during an 
aperture time and neld for conversion to a digital 
number, usually binary. Samoling and processing 
takes time which is specified as the conversion 
Lime. This is the total time required for a 
complete urement at one sample to achieve a 
given level of accuracy. If ¥g(t) is tne ide 
Giscrete-time representation of continuous process 
y(t), then the ADC output denoted by y;(t) is: 


‘ : g 
Yy * Yg-g 2 (20.3) 


where “d* 1s the conversion tine and c + & the 

accuracy tolerance at “d" as a function of rate-of- 
change in y(t). 
between d and ¢. for example, for a commonly 
available, high-quality 10-bit ADC, a conversion 


time of d= 10 us yields a maximum error of 3%. 


In general a trade-off exists 


Whereas given a 30 us conversion time, we can 
obtain 0.1% maximum error. 

The error due to conversion time "a" is many 
times negligible since processing in digital 
filters and spectrum analysis takes place after 
the converter. Conversion time delay can be of 
critical concern, however, where real-time proces~ 
sing at speeds of the order of "d" become important 
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such as in digital servo loops where corrections 
are needed for fast changing errors. 

A portion of the conversion-time error is a 
function of the rate of change 2 of the process 
if tne sample-and-hold portion of the ADC relies 
on the charging of a capacitor during an aperture 
time, This is true because the charge cycle will 
have a finite time-constant and because of aperture 
time uncertainty. For example, if the time-con- 
stant is 0.1 ns (given by say a 0.10 source 
resistance charging a 0.001 ufd capacitor), then 
a 0.1% nominal error will exist for slope 2 = 
1V/us due to charging. With good design, tnis 
error can be reduced. The sampling circuit (be~ 
fore charge) is usually the dominant source of 
error and logic gate-delay jitter creates an 
aperture time uncertainty. The jitter typically 
is between 2-5 ns which means an applied signal 
slewing at, say, 1 V/ys produces an uncertainty 
of 2-5 mV. Since ee is directly proportional 
to signal slewing rate, it can be anticipated that 
high-level, high-frequency components of y(t) will 
fave the greatest error in conversion. For typical 
ADC's, Jess than 0.1% error can be achieved by 
nolaing 2X to less than 0.2 V/us. 

The continuous process y(t) fs partitioned 
into 2" discrete ranges for n-bit conversion, All 
analog values within a given range are represented 
by the same cigital coae, usually assigned to the 
nominal midrange value. There {s, therefore, an 
inherent guantization uncertainty of 4 le 
significant bit (LSB), {n addition to other conver- 
sion errors. For example, a 10-bit AOC has a total 
of 1024 discrete ranges with a lowest order bit 


then representing about 0.1% of full scale and 
quantization uncertainty of = 0.05%. 

We define the dynamic range of a digital 
system as the ratio between the maximum allowable 
value of the process (prior to any overflow condi- 
tion) and the minimum discernable value. The 
dynamic range when digitizing the data is set by 
the quantizing uncertainty, or resolution, and 
is the ratio of 2” to 4 LSB. (If additive nofse 
makes coding ambiguous to the & LSB level, then 
the dynamic range is the ratio of 2” to the noise 
uncertainty, but this 1s usually not the case.) 


For example, the dynamic range of a 10-bit system 
fs 2" = 1026 to 4, or 2048 to 1. Expressed in 
8's, this is 


20 log 2048 = 66.2 GB 


if referring to a voltage-to-coge converter. 

The converter linearity specifies the degree 
to which the voltage-to-code transfer approximates 
a straight line. The nonlinearity is the deviation 
from a straight line drawn between the end points 
(all zeros to all ones code). It fs usually not 
acceptable to have nonlinearity greater than 4 LSB 
which means that the sum of the positive errors or 
the sum of the negative errors of the individual 
Dits must not exceed 4 LSB (or = 4 LSB). The 
linearity specification used in this context 
includes all effects such as temperature errors 
under expected operating temperature extremes and 
Power supply sensitivity errors under expected 
operating supply variations. 


10.3 Aliasing 

Figure 10.1 illustrates equispaced sampling 
of continuous process y(t). It is important to 
have a sufficient number of samples/second to prop- 
erly describe information in the high frequencies. 
Qn the other hand, sampling at too nigh a rate may 
unnecessarily increase the processing labor. As 
we reduce the rate, we see that sample values 
could represent low or high frequencies in y(t). 
This property is called aliasing and constitutes a 
source of error similiar to “imaging” which occurs 
in analog frequency mixing schemes (i.e., in the 
multiplication of two different signals 

If the time between samples (k) is T seconds, 
then the sampling rate is + samples per second. 
Then useful data in y(t) will be from 0 to Jy Hz 
and frequencies higher than dp Hz will be folded 
into the lower range from 0 to ad Hz and confused 
with data in this lower range. The cutoff fre- 
quency is then given by 


1 
f "7 10.4) 


and is sometimes called the “Nyquist frequency." 
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We can use the convolution theorem to siaply 
illustrate the existence of aliases. This theorem 
states that multiplication in the time domain 
corresponds to convolution in the frequency domain, 
and the time domain and frequency comain represen- 
tations are pairs.? The 
Fourter transform of y(t) in figure 10.1(a) is 
denoted by ¥(f); thus: 


= 
y(t) ‘ 
= 


% 
vit) = st bi vend tae 


Fourier transform 


a J2ftoe 


y{te (20.5) 


ang 


(10.6) 


The function Y(f) {s depicted in figure 10.2(a). 
The Fourier transform of a(t) is snown in figure 
10.2(d) and is given by a(f) where applying the 
discrete transform yields: 


» 
ane} D at-h, 


(20.7) 
Ls tel 
recalling that 
- 
a(t) = S 6(t -nt), (10.8) 
= 


from eq (10.2). 
Wheat 
+ 
? Na 
rer ea EY 
[7] 
we 
LY ts 
a 


FIGURE 10.2 


Y(f) convolved with af is denotea by Y(f)* 
(f) and is snown in figure 10.2(c), We see that 
the transform Y(f) is repeated with origins at 
f =. Conversely, nign frequency data with infor- 
mation around f = 2 will fold into the data around 


In the computation 
of power spectra, we encounter errors as shown in 
figure (10.3). 


the origin between -f. and +f, 


sy yo 
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FIGURE 10.3 


Aliased power spectra due to folding. 
Spectra, (b) Aliasea Spectra 


(a) True 


Two pioneers in information theory, 


Nyquist and Claude Shannon, 


Harold 
developed design 
criteria for discrete-continuous processing sys- 
tems. Given a specified accuracy, we can convey 
time-domain process y(t) tnrough a finite dand- 
width whose upper limit f, is the highest signifi- 
cant spectral For discrete- 
continuous process y(t), ideally tne input signal 
spectrum should not extend beyond f,, or 


component of y(t). 


(10.9) 


where f, is given by eq (10.4). Equation (10.9) 
is refered to as the “Shannon limit." 

In practice, there is never a case in which 
there is absolutely no signal or noise component 
above fy. Filters are used before the ADC in 
order to suppress components above f, which fold 
into the lower bandwidth of interest. This so- 
called anti-aliasing filter usually must be quite 
sophisticated in order to have low ripple in the 
passband, constant phase delay in the passbana, 
and steep rolloff characteristics. 
the rolloff 


In examining 
requirements of the anti-aliasing 
filter, we can apply a fundamental filter property 
that the output spectrum is equal to the input 
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spectrum aultiplied by the square of the frequency 
response function; that is, 


S(f) CHCA) }? = S(F) (20.10) 
out 


The filter response must be flat to f, and at- 
tenuate aliased noise components at f 2 f= 
anf.t f. In digitizing the data, the observed 
spectra will be the sum of the baseband spectrum 
(to fy) and all spectra which are folded into the 
baseband spectrum 


SON) S01 #81 (2F, = tS (2A A 
observed 
oS. (fy Ne +8) (21 3 #)) 
(10.22) 


5, (21 (f, + 9) 


” 
2 Soff) . 
i 


where M is an appropriate finite |imit. 

For a given rejection at an upper frequency, 
clearly the cutoff frequency f, for tne anti- 
aliasing filter snoula be as low as possible to 
relax the rolloff requirements. Recall that an 
nth order low-pass filter nas frequency response 
function 


1 
H(T) = 
te iG y (20.12) 
¢, 
and output spectrum 
scr) = Se (10.13) 
out 1 +(- 
- ¢, 


and after sampling, we have (applying eq (10.11)) 


“ 1 
Sf $,(2 1 (f, © Ff 
iw EO HEE ol 
observed ¢ tn i= 21, ¢ Od 
1*(r) 1+ — 
¢ c 


(10.14) 


If ‘e is chosen to be higher than tye then the 
first term (baseband spectrum) is negligibly 
affected by the filter, which {s our hope. It is 
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the second term (the sum of the folded in spectra) 
which causes an error. 

As an example of the rolloff requirement, 
consider the measurement of noise process n(t) at 
f = 400 Hz in a 1 Hz bandwidth on a digital spec- 
trum analyzer. Suppose n(t) is white; that is, 


Sat) * Ky (20.15) 


k, = constant 


Suppose further that we wish to only measure the 
noise from 10 Hz to 1 kHz; thus fy = 1 kHz. Let 
us assume a sampling frequency of f, = 2ty or 
2kHz. If we impose a 18 error limit in 
Sopserved and have 60 dB of dynamic range, then we 
can tolerate an error limit of 10-© due to aliasing 
effects in this measurement, and the second term in 
eq (10.14) must be reduced to tnis level. We can 
cnoose f. = 1.5kHz and obtain 


” ky 
S(f) eke ¢ +t an 
opserved =° 1M, 24 f+ 7 
2 
c 


(10.16) 


The term in the series which contributes most is 
at i =-1, the nearest foic-in. The denominator 
must be 10¢ or more to realize the allowable error 
Vimit and at n > 8 this condition is met. The 
next most contributing tera is i = +1 at which the 
error is < 10-7 for n= 8, a negligible contribu- 
tion. The error increases as f increases for a 
fixed n because the nearest fola-in (i = 1) is 
coming down in frequency (note fig. 10.2(c)) and 
power there is filtered less by the anti-aliasing 
filter. Let us look at the worst case (f = lkHz) 
to determine a design criteria for this example. 
At f = 1 kHz, we must have n> 10. 

Thus the requirement in this example is for a 
10-pole low-pass filter (60 dB8/octave rolloff). 


10.4 Some History of Spectrum Analysis Leading to 
the Fast Fourier Transform 


Newton in his Principia (1687) documented the 
first mathematical treatment of wave motion al~ 
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though the concept of harmonics in nature was 
pointed out by Pythagoras, Kepler, and Galileo. 
However, it was the work of Joseph Fourier in 1807 
which showed that almost any function of a real 
Variable could be represented as the sum of sines 
and cosines. The theory was rigorously treated fn 
a document in 1822. 

In using Fourier’s technique, the periodic 
nature of a process or signal is analyzed. Fourier 
analysis assumes we can apply fixed amplitudes, 
frequencies, and phases to the signal. 

In the early 1900's two relatively independent 
developments took place: (1) radio electronics 
and electric power hardware were fast growing 
technologies; and (2) statistical 
events or processes which were not periodic became 
radio 
explored signal and noise properties of a voltage 


analysis of 


increasingly understood. The engineer 
or current into a load by means of the spectrum 
analyzer and measurement of the power spectrum. 
On the other hand, statisticians explored deter- 
ministic and stochastic properties of a process by 
means of the variance and self-correlation pro- 
perties of the process at different times. Wiener 
(1930) showed that the variance spectrum (i.@., 
the breakdown of the variance with Fourier fre- 
quency) was the Fourier transform of the autocor~ 
relation function of tne process. He also theor~ 
{zed that the variance spectrum was the same as 
the power spectrum normalized to unit area. Tukey 
(1949) advocated the use of the variance spectrum 
in the statistical treatment of al] processes 
because (1) {t is more easily interpreted than 
correlation-type functions; and (2) it fortuitously 
is readily measureable by the radio engineer. 

The 1950's saw rigorous application of stati~ 
stics to communication theory. Parallel to this 
was the rapid advancement of digital computer 
hardware. Blackman and Tukey (1959) and Welch 
(1961) methods of 
deriving an estimate for the variance spectrum by 
taking the ensemble time-average sampled, discrete 
line spectra. The approach assumes the random 
process is ergodic. Some digital approacnes 
estimate the variance spectrum using Wiener’s 
theorem if correlation-type functions are useful 


elaborated on other useful 
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in the analysis, but in general the time-averaged, 
sample spectrum {s the approach taken since its 
implementation fs direct and straigntforward. 
Most always, ergodicity can be assumed. 8.9 

The variance of process y(t) fs related to 
‘the total power spectrum by 


. 
arfy(t)] = f S(t) af. (10.17) 
= 
Since 
wage 
oy(t)] = ro apf yi(t) at (20.18) 


we see that if y(t) is a voltage or current into @ 
l-onm load, then the mean power of y(t) is the 
integral of S_(f) with respect to frequency over 
the entire range of frequencies (-=,=). sy(t) is, 
the power spectrum of process y(t). 
The power spectrum curve shows how the variance is 
distributed with frequency and should be expressed 
in units of watts per unit of frequency, or volts 
squared per unit of frequency when the load is not 
considerec. 

Direct estimation of power spectra has been 
carried out for many years through the use of 


therefore, 


analog instruments. These have variously been 
referred to as sweep spectrum analyzers, harmonic 
analyzers, filter banks, and wave analyzers. 


These devices make use of the fact that the spec- 
trum of the output of a linear system (analog 
filter) is the spectrum of the input multiplied by 
the square of the system's frequency response 
function (real part of the transfer character~ 
istic). Mote eq (10.10). If y(t) has spectrum 
S.(f) feeding a filter with frequency response 
function H(f), then {ts output is 


S(f) 


= (HCA)]# SCF) 
filtered 


(10.19) 


If H(f) fs rectangular in shape with width of, 
then we can measure the contribution to the total 
power spectrum due to $,(f %. 

The cevelopment of the fast Fourier transform 
(FFT) in 1965 made digital metnods of spectrum 
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increasingly attractive. Today the 
choice between digital or analog methods depends 
more on the objectives of the analysis rather than 
on technical limitations. However, many aspects 
of digital spectrum analysis are not well known by 
the casual user in the laboratory while the analog 
analysis methods and their limitations are under- 
stood to a greater extent. 

Digital spectrum analysis is realized using 
the discrete Fourier transform (DFT), a modified 
version of the continuous transform depicted in 
eqs (10.5) and (10.6). By sampling the input 
waveform y(t) at discrete intervals of time ts 
At representing the sampled waveform by eq (10.2) 
and integrating eq (10.5) yields 


e 
vt) = SS ycarye IFT (30, 20) 
inne 


Equation (10.20) is a Fourier series expansion. 
Because f(t) is specified as being bandlimitea, 
the Fourier transform as calculated by eq (10.20) 
is as accurate as eq (10.5); however, it cannot 
extend beyond the Nyquist frequency, eq (10.4). 

In practice we cannot compute the Fourier 
transform to an infinite extent, and we are re 
stricted to some observation time T consisting of 
AAt intervals. This produces a spectrum which is 
mot continuous in f but rather fs computed with 
resolution af where 


ote = } (20.21) 
With this change, we get the discrete finite 
transform 


Y(nat) = bas yg tye" Smart (10.22) 


The OFT computes a sampled Fourier series, 
and eq (10.22) assumes that the function y(t) 
repeats itself with period T. Y(maf) is called 
the "line spectrum." A comparison of the OFT with 
the continuous Fourier transform is shown later in 
part 10.7. 
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The fast Fourier transform (FFT) is an algor- 
{thm which efficiently computes the line spectrum 
by reducing the number of adds and multiplies 
involved fn eq (10.22). If we choose T/at to 
equal a rational power of 2, then a symmetric 
matrix can be derived through which ygt) passes 
and quickly yields Y(maf), An N-point transfor- 
mation by the direct method requires a processing 
time proportional to N2 whereas the FFT requires a 
time proportional to N log, N. The approximate 
ratio of FFT to direct computing time is given by 


N log, N log, W 

aati 
where N= 2¥. if N= 210, the FFT 
requires less than 1/100 of the normal processing 
time. 

We must calculate both the magnitude and 
phase of a frequency in the line spectrum, i.e 
the real and imaginary part at the given frequency. 
N points im the time domain allow N/2 complex 
quantities in the frequency domain. 

The power spectrum of y(t) is computed by 
squaring the real and imaginary components, adding 
the two together and dividing by the total time T. 
We have 


S,(nat) = RLV(mat))? + Ty(mat))? 


This quantity is the sampled power spectrum 
and again assumes periodicity in process y(t) with 
total period T.i0 


10.5 Leakage 

Sampled digital spectrum analysis always 
involves transforming a finite block of data. 
Continuous process y(t) is “looked at" for T time 
through a data window which can functionally be 
described by 


(20.23) 


For example, 


(10.24) 


y'(t) = w(t)-y(t) (10.25) 
where w(t) fs the time domain window. The time 
discrete counterpart to eq (10.25) is 

yg t) = w,(t)-y,(t) (20. 26) 


and w(t) is now the sampled version of w(t) 
derived similarly to eq (10.2). Equation (10.26) 
is equivalent to convolution in the frequency 
domain, or 
Y' (maf) = w(mat)*¥(maf) (10.27) 
Y' (maf) is callea the "modified" line spectrum due 
to convolution of the original line spectrum with 
the Fourier transform of the time-domain window 
function. 
Suppose the window function is rectangular, 


and . 
-T T 
w(t) = 2 ets 
2 . B+ i772 
ai, . 4% bi (10.28) 
This window is snown in figure 10.4(a). The 


Fourter transform of this window is 


wnat) = 7 Sime nae NT 


(10. 29) 


and is shown in figure 10.4(b). If y(t) is a sine 
wave, we convolve the spectrum of the sinusoid, a 
delta function, with w(maf). 


FIGURE 10.4 
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The transform process (eq 10.22) treats tne 
sample signal as if it were periodically extended. 
Discontinuities usually occur at the ends of the 
window function in the extended version of the 
sampled waveform as in figure 10.5(c). Samole 
spectra thus represent a periodically extended 
sampled waveform, complete with discontinuftes at 
its ends, rather than the original waveform. 


(a) 
(b) ——s 


FIGURE 10.5 
components appear 
spectrum and this is referred to as 
Leakage results from discontinuites in the periodi- 
cally extended samole waveform. 

Leakage cannot be eliminated entirely, but 


Spurious near the sinusoid 


one can choose an appropriate window function w(t) 
in order to minimize its effect. This is usually 
done at the expense of resolution in the frequency 
domain. An optimum window for most cases is the 


Hanning window given by: 


wit) = (5 + F cos (Bt? (10.30) 


for 0 < t < T and “a" designates the number of 
times the window is implemented. Figure 10.6(a) 
shows the window function and 10.6(b) shows tne 
Hanning line shape in the frequency domain for 
various numbers of “Hanns.” Note that this window 
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FIGURE 10.6 
eliminates discontinuities due to tne ends of 
sample length T. 

Each time the Hanning window fs applied,the 
sidelobes in tne transform are attenuated by 12 
OB/octave, and the main lobe is widened by 2af. 
The amplitude uncertainty of an arbitrary sine 
wave input is reduced as we incre the number of 
Hanns; however, we trade off resolution in fre- 
quency, 

The effective noise bandwidth indicates the 
departure of the filter respon: 


away from a true 
rectangularly shaped filtered response (frequency 
domain). Table 10-1 lists equivalent noise band- 
width corrections for up to three applications of 
the Hanning window, 11 


Equivalent Noise 


Number_of Hanns Bandwidth 

1 1.5 of 

2 1.92 af 

3 2.31 af 
TABLE 10.1 
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The effect of leakage discussed in the pre- 
vious section gives rise to a sidelobe type re- 
sponse that can be tailored according to the 
time-window function through which the analyzed 
signal passes as a block to be transformed to the 
frequency domain. Using the Hanning window dimin- 
ishes the amplitudes of the sidelobes, however, it 
increases the effective bandwidth of the passband 
around the center frequency. This is because the 
effective time-domain window length is shorter 
than a perfect rectangular window. Oirectly 
related to the leakage (or sidelobe) effect is one 
called the “picket-fence” effect. This is because 
the sidelobes themselves resemble a frequency 
response which has geometry much like a picket 
fence. 

The existence of both sidelobe leakage and 
the resultant picket-fence effect are an artifact 
of the way in which the FFT analysis is performed. 
Frequency-domain analysis using analog filters 
involves a continuous signal in and a continuous 
signal out. On the other hand, FFT analysis 
involves a continuous signal in, but the transform 
to the frequency domain is performed on blocks of 
data. In order to get discrete frequency informa- 
tion from a block, the assumption is made that the 
block represents one period of a periodic signal. 
The pickel 
this assumption. for example, consider a sinewave 
signal which {is transformed from a time-varying 
voltage to a frequency-domain representation 
through an FFT. The block of data to be transform= 
ed will be length, T, in time. Let's say that the 
block, T, represents only 4 cycles of the input 
Sinewave as in figure 10.5. Artificial sidebands 
will be created in the transform to the frequency 
domain, whose frequency spacing equals i. or the 
reciprocal of the block length. This represents 
@ worst-case condition for sidelobe generation 
and creates a large number of spurious discrete 
frequency components as shown in figure 10.7(b). 

If, on the other hand, one changes the dDiock 
time, T, so that the representation is an integral 
number of cycles of the inout sinewave, then the 
transform will not contain sidelobe leakage compo- 


fence effect fs a direct consequence of 
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FIGURE 10.7 
nents and the artificial sidepand frequency compo- 


ments disappear. In practice, when looking at 
complex input signals, the block time, T, is not 
synchronous with any component of the transformed 
part of the signal. As a result, discrete fre- 
quency components in the frequency domain have 
associated with them sidebands which come and go 
depending on the phase of the time window, T, 
relative to the sine components of the incoming 
signal. The effect is much like looking through a 
picket fence at the sidebands, 12 

An analogy to the sidelobe leakage and picket- 
fence effect is to record the incoming time-varying 
signal on a tape loop, which has a length of time, 
T. The loop of tape then repeats itself with a 
period of T. This repeating signal 1s then coupled 
to a scanning or filter-type spectrum analyzer. 
The phase discontinuity between the end of one 
passage of the loop and the beginning of the loop 
on ftself again represents a phase-modulation 
component, which gives rise to artificial sidebands 


in the spectrum af A word of caution — 


lysis. 
this fs mot what actually happens in a FFT analyzer 
(i.@., there fs no recirculating memory). However, 
the Fourier transform treats the incoming block as 
if this were nappening. 


10.7 Time Domain-Frequency Domain Transforms 
A. Integral transform 


Figure 10.8 snows tne well-known integral 
transform, which transforms 4 continuous time- 
domain signal extending over al) time into a 


FIGURE 10.8 
continuous frequency-domain signal extending over 
all frequency. This is the ideal transform. In 
practice, however, one seals with finite times and 
bandwidths. The integral transform then, at dest, 
is an estimate of the transform and is so for only 
short, well-penaved signals. That is, the signal 


goes to zero at infinite time and at infinitely 
nigh frequency. 


r-series transform assumes perio- 
Gicity in tne time-domain signal for all time. 
Only one period of the signal (for time T) is 
required for this kind of transform. The Fourier 
series treats tne incoming signal as periodic with 
period, T, and continuous, The transformed spec- 
then discrete with 
components with frequency spacing of . 
shown in figure 10.9. 


infinite harmonic 
This is 


trum is 


TORR SES 
weet 


Goethe a 
= 


FIGURE 10.9 
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FIGURE 10.10 

Figure 10.10 shows the transform from a sam 
pled time-domain signal to the frequency domain. 
Note that in the frequency domain, the result is 
repetitive in frequency. This effect, commonly 
called aliasing, is discussed earlier in section 
10.3, Figure 10.9 and figure 10.10 show the sym 
metry between the time- and frequency-domain trans~ 
forms of discrete lines. 


C. Oiscrete fourier transform 

Finally, we have the sampled, periodic 
(assumed) time-domain signal which is transformed 
to a discrete and repetitive (aliased) frequency 
domain representation. This is shown in figure 
10.11 


RCRETIC FOURIER TRONS 
Ted Ee 
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oo) Ewe 


FIGURE 10.11 
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AI. TRANSLATION FROM FREQUENCY DOMAIN STABILITY 


MEASUREMENT TO TIME DOMAIN STABILITY MEASURE- 
MENT_ANO VICE-VERSA. 


21.1 Procedure 

Knowing how to measure S,(f) or s(t) for a 
pair of oscillators, let us see how to translate 
the power-law noise process to a plot of o 2(t). 
First, convert the spectrum data to sy(f), the 
spectral density of frequency fluctuations (see 
sections III and VIII). There are two quantities 
which completely specify S.(f) for a particular 
power-law noise process: (1) the slope on a 
log-log plot for a given range of f and (2) the 
amplitude. The slope we shall denote by “a”; 
therefore is the straignt line (on log-log 
scale) which relates S(f) to f. The amplitude 
will be denotea “n,"; it is simply the coefficient 
of f for a range of f. When we examine a plot of 
spectral density of frequency fluctuations, we are 
looking at @ representation of the addition of al] 


the power-law processes (see sec. IX). We have 
= 
sins Dae aun 
y an, 6 


In section IX, five power-law noise processes 
were outlined with respect to $,(f)- These five 
are the common ones encountered with precision 
oscillators. Equation (8.7) relates these noise 
processes to SC). One obtains 


with respect to 


sy(f) 
1. Random Walk FM (f-?). 2. a = -2 
2. Flicker FH (8). 6 eal 
3. White Fw @ ..-.e2 0 
4. Flicker oM @) ...@81 
5. White om (f4) 2. .a8 2 
slope on 
log-log 
paper 


Table 11.1 fs a list of coefficients for 
translation from oy3(t) to sof) and from 5,9) to 
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oy3{t). In the table, tne left column is the 
designator for the power-law process. Using the 


middle column, we can solve for the value of sy(f) 


Dy computing the coefficient 
measured time domain data o ?(rt). 


and using the 
The rightmost 
column yields a solution for o 2(t) given frequency 
domain data 5,(f) and a caiculation of the appro- 
priate “b" coefficient. 


2 
(white phase) 


sf) re a y(t) 


(au? ir 3, 
h ayy 


EXAMPLE: 

In the phase spectral density plot of figure 
11.1, there are two power-law noise processes for 
oscillators betng comparea at 1 MHz. For region 
1, we see that when f increases by ane decade 
(that is, from 10 Hz to 100 Hz), 5,(f) goes down 
by three decades (that is, from 10-41 to 10-74). 


Thus, S,(f) goes as 1/f? = f-3. For region 1, we 


oy 2) sd b 5,01) 


{1.038 + 3 In(u,t)]f 


1 (eu vet 
(flicker noise) T. ° ACw, Tay? te 4 
C) 2t f2 
(white frequency) Tu 
a 2.1n (2) + #2 
(flicker frequency) Tiny -F yi 


sg 2nj2_ 1 f* 
(random walk frequency) ty ttt v5 
TABLE 11.1 


Conversion table from time domain to frequency domain and from frequency 
Gomain to time domain for common kinds of interger power law spectral densities; 


%% 
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SPECTRAL DESTTY OF PHASE. 
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FIGURE 11.12 
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ti(2 w/a) is the measurement system bandwidth. 
Rtnin™3 dB from 0.C. to t, (3 dB down nigh=frequency cutoff is at f,). 


Measurement reponse should be 


igentify tnis noise process as flicker FM. The 
rightmost column of table 11.1 relates o%(t) to 
S(f). The flicker 
noise yields: 


ox(r) = BPD 5 vt) 
0 


row designating frequency 


One can pick (arbitrarily) a convenient Fourier 
frequency { and determine the corresponding values 
of $,¢1) given by the plot of figure 11.1. Say, 
f= 10, thus $,(10) = 10-14. Solving for He), 
given vy = 1 MHz, we obtain: 


o8(t) = 1.39 x 10-20 


therefore, o.(t) = 1.18 x 10-29. For region 2, we 
have white PM. The relationship between a(t) and 
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Sy(f) for white PM is: 


if 
h 
oF Ct) = Teo 


Again, we choose a Fourier frequency, say f = 100, 
and see that S,(100) = 10-4*, Assuming f, = 10* 
Hz, we thus optain: 


od(t) = 7.59 x 10-26, 2, 


therefore, 
ay(t) * 2.76 x 10-12 2, 


The resultant time domain characterization is 
shown in figure 12.2. 


we of o 2 0 
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FIGURE 11.2 


The translation of Sy) of figure 11.1 yields this 
oy(t) plot. 


o 


ote 


FIGURE 11.3 
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FIGURE 11.4 
Figures 11.3 and 11.4 show plots of time- 
domain stability and a translation to frequency 
domain. Since table 11.2 has the coefficients 
which connect both the frequency and time domains, 
it may be used for transiation to and from either 
domain. 


XII. CAUSES OF NOISE PROPERTIES IN A SIGNAL SOURCE 


12.1 Power-law Noise Processes 

Section IX pointed out the five commonly used 
power-law models of noise. With respect to 3.(f), 
‘one can estimate a staight line slope (on a log-log 
scale) which corresponds to a particular noise 
type. This is shown in figure 12.1 (also fig.9.1). 


SPECTRAL DENSITY OF PHASE 


ro io! 1? 10" teher 
FOURIER FREQUENCY (1) 


FIGURE 12.1 
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We can make the following general remarks about 
power-law noise processes: 


1 Random walk FM (1/f*) noise is difficult 
to measure since it is usually very 
close to the carrier. Random walk FM 
usually relates to the OSCILLATOR'S 
PHYSICAL ENVIRONMENT. If random walk FM 
iS & predominant feature of the spectra! 
density plot then MECHANICAL SHOCK, 
VIBRATION, TEMPERATURE, or other envi~ 
ronmental effects may be causing “random” 
shifts in the carrier frequency. 


2. Flicker FM (1/f?) is a noise whose 
physical usually not fully 
understood but may typically be related 
to the PHYSICAL RESONANCE MECHANISM OF 
AN ACTIVE OSCILLATOR or the DESIGN OR 
CHOICE OF PARTS USED FOR THE ELECTRONICS, 
or ENVIRONMENTAL PROPERTIES. Flicker FM 
is common in nign-quality oscillators, 


cause is 


but may be masked by white FM (1/f?) or 
flicker PM (1/f) in lower-quality oscil- 
ators. 


3. White FM (1/f?) noise fs a common type 
found in PASSIVE-RESONATOR FREQUENCY 
STANDARDS. These contain a slave oscil- 
lator, often quartz, which is locked to 
a resonance feature of anotner device 
which behaves much like a high-Q filter 
Cesium and rubidium standards have white 
FM noise characteristics. 


4. Flicker M (1/f) noise may relate to a 
physical resonance mechanism in an 
oscillator, but it usually is added by 
NOISY ELECTRONICS. This type of noise 
is common, even in the highest quality 
oscillators, because in order to bring 
the signal amplitude up to a usable 
level, amplifiers are used after the 
signal source. Flicker PM noise may be 
introduced in these stages. It may also 
be introduced in a frequency multiplier. 


© See Appendix Note # 7 
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Flicker PM can be reduced with good 
low-noise amplifier design (e.g., using 
rf negative feedback) and hand-selecting 
transistors and other electronic com- 


ponents. 


5. White PM (f°) noise is broadband phase 
noise and has little to do with the 
resonance mechanism. It is probably 
produced by similar phenomena as flicker 
PM (1/f) noise, STAGES OF AMPLIFICATION 
are usually responsible for white PM 
noise. This noise can de kept at a very 
Yow value with good amplifier design, 
hand-se }d components, the addition 
of narrowband filtering at the output, 
or increasing, if feasible, the power of 


the primary frequency source.!3 


12.2 Other _types of noise 


A commonly encounterea type of noise from a 
signal source or measurement apparatus is tne 
presence of 60 Hz A.C. line noise. Shown in 
figure 12.2 is a constant white PM noise source 
with 60 Hz, 120 Hz and 180 Hz components added. 
This kind of noise is usually caused by AC power 
getting into the measurement system or the source 
under test, In the plot of Sy(f), one observes 
discrete line spectra. Althougn 5,(f) is a measure 
of spectral density, one can interpret the line 
spectra with no loss of generality, although one 
usually does not refer to spectral densities when 
characterizing discrete lines. Figure 12.3 fs the 
time domain representation of the same white pnase 
modulation level with 60 Hz noise. Note that the 
amplitude of o (t) varies up and down depending on 
sampling time. This is decause in the time domain 
the sensitivity to a periodic wave varies directly 
as the sampling interval. This effect (which is 
an alias effect) is a very powerful tool for 
filtering out a periodic wave imposed on a signal 
By sampling in the time domain at integer 
insensitive to the 


source. 
periods, one is virtually 
periodic (discrete line) tera. 
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FIGURE 12.2 
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FIGURE 12.3 
For example, diurnal variations in data due to day 
to day temperature, pressure, and other environ- 
mental effects can be eliminated by sampling the 
data once per day. This approach is useful for 
data with only one periodic term. 

Figure 12.4 shows the kind of plot one might 
see of S.(f) with vibration and acoustic sen- 
sitivity in the signal source with the device 
under vibration. Figure 12.5 shows the transia- 
tion to the time domain of this effect. Also 
noted in figure 12.4 is a (typical) flicker FM 
benavior in the low frequency region. In the 
translation to time domain (fig. 12.5), the flicker 


FM behavior masks the white PM (with the super- 
imposed vibration characteristic) for long aver- 


aging times. 


FIGURE 12.4 
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FIGURE 12.5 

Figure 12.6 shows examples of plots of two 
power law processes (S.(f)) with a change in the 
flicker FM level. (Example 1 is {dentical to the 
example given in sec. XI.) Figure 12.7 indi- 
cates the effect of a lower flicker FM level as 
translated to the time domain. Note again tne 
existence of both power law noise processes. 


However for a given averaging time (or Fourier 
frequency) one noise process may dominate over the 
other. 
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FIGURE 12.10 


Excess device noise from transistors, capa- 
citors, resistors, and the like can introduce a 
jow frequency noise which has been referred to as 
“popcorn” noise because of its sonic qualities. 
Figure 12.8 snows a plot of $,(f) from a signa) 
Source having such excess low frequency noise. 
Figure 12.9 is the time domain representation. 
The rise in amplitude of o for long averaging 
times is particularly aggravating. The solution 
to this king of problem if it is introduced by 
Gevices is to carefully grade the devices in the 
assembly and testing process. 

Stages of amplification following a signal 
source many times rely on local degenerate or 
overall negative feedback scnemes in order to 
minimize the excess noise from active gain elements 
(such as transistors). This is the recommended 
design approach. However, phase shift in the 
Negative feedback circuit or poor bandwidth in the 
gain elements can result in poor high frequency 
Moise behavior. Figure 12.10 shows a kind of 
result one might see as a gradual rise in 5,(1) 
because of insufficient negative feed back at 
high Fourier frequencies. 

Section K discussed aliasing in the frequency 
domain. Figure 12.11 shows the resultant measure- 
ment anomaly due to digital sampling of a poorly 
bandlimited (anti-aliased) white noise source. 
Noise voltage above the sampling frequency f. is 
folded into the analysis region of interest. Note 
also that the stopband ripple characteristics are 
folded into the high-frequency portion of the 
passband. For a given sampling frequency, @ 
Compromise exists between increasing the high= 
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frequency extent of the analysis band and improving 
the anti-aliasing filter's stopband rejection 
Section X has an example of the filter requirements 
for a particular case 


XIII. CONCLUSION 


This writing hightignts major aspects of 
time-domain and frequency-domain oscillator signal 
measurements. The contents are patterned after 
lectures presented by the authors. The authors 
have tried to de general in the treatment of 
topics, and bibliography fs attached for readers 
who would like details about specific items 
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LIST OF SYMBOLS 
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Transfer function of a filter 
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12.1 CONCEPTS, DEFINITIONS, AND MEASURES 
OF STABILITY 


This chapter deals with the measurement of the frequency or time stability 
of precision oscillators. It is assumed that the average output frequency is 
determined by a narrow-band circuit so that the signal is very nearly a sine 
wave. To be specific, it is also assumed that the output is a voltage, which is 
conventionally (Barnes er al., 1971) represented by the expression 

Vig) = [Vo + aft) sin{2xvor + gin), (12-1) 
where V, is the nominal peak voltage amplitude, e(r) the deviation of 
amplitude from nominal, vp the nominal fundamental frequency, and (¢) the 
deviation of phase from nominal. 

When either specifying or measuring the noise in an oscillator, one must 
consider the nature of the reference. This may be either a passive circuit such 
as a narrow-band filter, another similar oscillator, or a set of oscillators, 
synthesizers, and other signal-generating equipment. A reference with lower 
noise than the device under test may be available, and in this case the 
expressions developed in this chapter describe the noise in the oscillator 
alone. However, a state-of-the-art device will have lower noise than any 
available reference. In this case all the expressions below refer to the sum of 
device and reference noise. The most common approach to solving this 
problem is to compare two or more nearly identical devices. Under most 
circumstances it is then reasonable to assume that each oscillator contributes 
half of the measured noise. 

The most direct and intuitive method of characterizing the properties of 
a signal is to determine the two-sided spectrum of V(r), which is denoted 
SVS) (Rutman, 1978). The variable f is called a Fourier frequency and is 
very closely related to the concept of a modulation frequency. A positive 
S indicates a frequency above the carrier frequency vo, while a negative f 
indicates a frequency lower than the carrier. Since the noise can in theory 
modulate the carrier at all possible frequencies, a continuous function is 
fequired to describe the modulation of V(r). S is called a spectral density and 
SH.) is the mean-square voltage (V*(1)> in a unit bandwidth centered at/. It 
is proportional to the rf power per unit bandwidth delivered by the oscillator 
to a matched load. The total signal power is proportional to the mean square 
voltage, which is also called the variance of the signal since the mean value of 
V{e) is zero. The variance is therefore equal to the two-sided spectral density 
integrated over all frequencies. 

The two-sided spectrum is usually measured by an rf spectrum analyzer, a 
device that functions like a bandpass filter followed by a bolometer, as shown 
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FIG. 12-1 An ef spectrum analyzer. The device produces an output proportional to the 
mean-square value of the signal passing through a tunable narrow-band filter centered at 
frequency fo. 


in Fig. 12-1. The spectrum of the filtered voltage V(r) is equal to the square 
of the magnitude of the filter transfer function H( f — f,) multiplied by the 
spectrum of the input signal (Cutler and Searle, 1966). The variance of the 
filtered voltage is obtained from Parseval's theorem: 


otf) f 


1H — fo? SPU) af (12-2) 


If the bandpass filter is sufficiently narrow, so that SY f) changes negligibly 

over its bandwidth, then Eq. (12-2) may be inverted. With this assumption, 

the power spectrum is estimated from the measurement using Eq. (12-3); 
ST fo) = oF(fo)/B, (12-3) 


where B = [®, |H(f’ — fo)l? df” is the noise bandwidth of the filter and f, its 
center frequency. Figure 12-2 shows a typical two-sided rf spectrum. For 
many oscillators the spectrum has a Lorentzian shape, that is, 
2¢V>/m Mfsan 
- . 12-4) 
SU) = Gita IF ial 
The Lorentzian lineshape is completely described by the mean square voltage 
<¥?) and the full width at half maximum Afyas- 


sin) 


=te0 te t 


FIG. 12-2. The rf spectrum of a signal It is often useful to divide the spectrum into the 
carrier and the noise pedestal, The spectral density of the carrier exceeds that of the noise 
pedestal for Fourier frequencies smaller in magnitude than f, . 
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12.1.1 Relationship between the Power Spectrum and the 
Phase Spectrum 


The power spectrum differs from a delta function 5{f) due to the presence 
of the amplitude- and phase-noise terms, e() and $(t), respectively, included 
in Eq, (12-1). Usually the noise modulation separates into two distinct 
components, so that one observes a very narrow feature called the carrier 
above the level of a relatively broad pedestal, The frequency that separates 
the carrier and pedestal is denoted f,. Below this frequency the spectral 
density of the carrier exceeds that of the pedestal. Assuming that the ampli- 
tude noise is negligible compared to the phase noise and that the phase 
modulation is small, the relationship between the power and phase spectra 
is given by (Walls and DeMarchi, 1975) 


Va, [4S if heS<h. 
SPUD & pert x STN), otherwise. 
SUS) is the two-sided spectrum of the phase fluctuations, which divides 


into a carrier component SJ3,(f) and a pedestal component SJ3,(/); MJ) is 
given by 


(12-5) 


Nh= " Seid = ii sind (12-6) 


since above f, the pedestal dominates the noise spectrum. The variance of the 
carrier is equal to (V3/2)e~'4*), with the remaining variance in the pedestal. If 
Av, is the width of the pedestal and Av, the width of the carrier, then the 
power density in the carrier is equal to that in the pedestal when [(/.) = 
In(Av,/Av,). For the pedestal, one may use the 3-dB linewidth for Av, 
provided that [7 S,(f) df < In 2. Otherwise the pedestal width is estimated 
from [5,2 S,(f) df = In 2. For the carrier, the linewidth is estimated by 
calculating fF... Sp. S) df = In 2. 

The foregoing analysis makes it possible to draw certain conclusions 
concerning detection of the carrier. We use fo df to denote the integral over 
the phase noise pedestal. If f, S,(f) df < In 2, then the carrier may be resolved 
irrespective of detector bandwidth. When In(Av,/Av,) > J, Sif) df > In 2. 
the carrier may be resolved by restricting the detection bandwidth. But when 
J, S.(S) df > In(Av,/Av,), the carrier can no longer be distinguished from the 
pedestal since its spectral density is smaller. 


12.1.2 The IEEE Recommended Measures of Frequency Stability 


By the mid-1960s the problem of the specification of precision oscillators 
had become extremely important, but there was very little uniformity among 
manufacturers, metrologists, and applications engineers in the methods of 
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performing measurements or the description of measurement results. This 
situation was complicated by the difficulty of comparing the various 
descriptions. A measure of stability is often used to summarize some 
important feature of the performance of the standard. It may therefore not be 
possible to translate from one measure to another even though the respective 
measurement processes are fully described and all relevant parameters are 
given. This situation resulted in a strong pressure to achieve a higher degree 
of uniformity. 

In order to reduce the difficulty of comparing devices measured in separate 
laboratories, the IEEE convened a committee to recommend uniform 
measures of frequency stability. The recommendations made by the com- 
mittee are based on the rigorous statistical treatment of ideal oscillators that 
obey a certain model (Barnes et al, 1971), Most importantly, these oscillators 
are assumed to be elements of a stationary ensemble. A random process is 
stationary if no translation of the time coordinate changes the probability 
distribution of the process. That is, if one looks at the ensemble at one instant 
of time, then the distribution in values for a process within the ensemble is 
exactly the same as the distribution at any other instant of time. The elements 
of the ensemble are not constant in time, but as one element changes value 
other elements of the ensemble assume previous values. Thus, it is not 
possible to determine the particular time when the measurement was made. 

The stationary noise model has been adopted because many theoretical 
results, particularly those related to spectral densities, are valid only for this 
case, It is important for the statistician to exercise considerable care since 
experimentally one may measure quantities approximately equal to either the 
instantaneous frequency of the oscillator or the instantaneous phase. But the 
ideal quantities approximated by these measurements may not both be 
stationary. The instantaneous angular frequency is conventionally defined as 
the time derivative of the total oscillator phase. Thus, 


d 
w= [2avor + oir), (12-7) 


and the instantaneous frequency is written 


da 
Wi) = 9 + xe. (12-8) 


For precision oscillators, the second term on the right-hand side is quite 
small, and it is useful to define the fractional frequency 


ae (12-9) 


a 49 — Yo = 
2rvg dt dt” 
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where 
x(t) = $(1)/2tv9 (12-10) 


is the phase expressed in units of time. Alternatively, the phase could be 
written as the integral of the frequency of the oscillator: 


$10) = 0 + [2s ~ v9) 48. (2-11) 


However, the integral of a stationary process is generally not stationary. 
Thus, indiscriminate use of Eqs. (12-7) and (12-11) may violate the assump- 
tions of the statistical model. This contradiction is avoided when one 
accounts for the finite bandwidth of the measurement process. Although a 
more detailed consideration of the statistics goes beyond the scope of this 
treatment, it is very important to keep in mind the assumption that lie behind 
the statistical analysis of oscillators. In order to analyze the behavior of real 
oscillators, it is necessary to adopt a model of their performance, The model 
must be consistent with observations of the device being simulated. To make 
it easier to estimate the device parameters, the models usually include certain 
predictable features of the oscillator performance, such as a linear frequency 
drift. A statistical analysis is useful in estimating such parameters to remove 
their effect from the data. It is just these procedures for estimating the 
deterministic model parameters that have proved to be the most intractable. 
A substantial fraction of the total noise power often occurs at Fourier 
frequencies whose periods are of the same order as the data length or longer. 
Thus, the process of estimating parameters may bias the noise residuals by 
reducing the noise power at low Fourier frequencies. A general technique for 
minimizing this problem in the case of oscillators actually observed in the 
laboratory is discussed below. 

Ithas been suggested that measurement techniques for frequency and time 
constitute a hierarchy (Allan and Daams, 1975), with the measurement of the 
total phase of the oscillator at the peak. Although more difficult to measure 
with high precision than other quantities, the total phase has this status 
owing to the fact that all other quantities can be derived from it. 
Furthermore, missing measurements produce the least deleterious effect on a 
time series consisting of samples of the total phase. Gaps in the data affect the 
computation of various time-dependent quantities for times equal to or 
shorter than the gap length, but have a negligible effect for times much longer 
than the gap length. The lower levels of the hierarchy consist of the time 
interval, frequency, and frequency fluctuation. When one measures a quan- 
tity somewhere in this hierarchy and wishes to obtain a higher quantity, it is 
necessary to integrate one or more times. In this case the problem of missing 
data is quite serious. For example. if frequency is measured and one wants to 
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know the time of a clock, one needs to perform the integration in Eq. (12-11). 
The missing frequency measurements must be bridged by estimating the 
average frequency over the gap, resulting in a time error that is propagated 
forever. Thus, it is preferable to always make measurements at a level of the 
measurement hierarchy equal to or above the level corresponding to the 
quantity of principle interest. In the past this was rather difficult to do. 
Measurement systems constructed from simple commercial equipment suf- 
fered from dead time, that is, they were inactive for a period after performing 
a measurement. To make matters worse, methods for measuring time or 
phase had considerably worse noise performance than methods for measur- 
ing frequency. As a result, many powerful statistical techniques were 
developed to cope with these problems (Barnes, 1969: Allan, 1966). The effect 
of dead time on the statistical analysis has been determined (Lesage and 
Audoin, 1979b). Other techniques have been developed to combine short 
data sets so that the parameters of clocks over long periods of time could be 
estimated despite missing data (Lesage, 1983). The rationale for these 
approaches is considerably diminished today. Low-noise techniques for the 
measurement of oscillator phase have been developed. Now, commercial 
equipment is capable of measuring the time or the total phase of an oscillator 
with very high precision. Other equipment exists for measuring the time 
interval. These devices use the same techniques that were previously 
employed for the measurement of frequency and are very competitive in 
performance. 

The proliferation of microcomputers and microprocessors has had an 
equally profound effect on the field of time and frequency measurement. 
There has been a dramatic increase in the ability of the metrologist to acquire 
and process digital data. Many instruments are available with suitable 
standard interfaces such as IEEE-583 or CAMAC (IEEE, 1975) and 
TEEE-488 (IEEE, 1978). As a result, there has been a dramatic change in 
direction away from analog signal processing toward the digital, and this 
process is accelerating daily. Techniques once used only by national 
standards laboratories and other major centers of clock development and 
analysis are now widespread. Consequently, this chapter will focus first on 
the peak of the measurement hierarchy and the use of digital signal 
Processing. But the analysis is directed toward estimating the traditional 
measures of frequency stability. Considerable attention will be paid to 
problems associated with estimating the confidence of these stability meas- 
ures and obtaining the maximum information from available data. 

The IEEE has recommended as its first measure of frequency stability the 
one-sided spectral density Sf) of the instantaneous fractional-frequency 
fluctuations )(1). It is simply related to the spectral density of phase fluctua- 
tions since differentiation of the time-dependent functions is equivalent to 


12 FREQUENCY AND TIME MEASUREMENT 199 


multiplication of their Fourier transforms by je: 


SAP) = (five SAS) = (2/7 S1S). (12-12) 

Section 12.1.1 on the relationship between the power spectrum and the 
phase spectrum described the analog method for the measurement of a 
spectral density. If a voltage Vis the output of the oscillator, then the result of 
the measurement is proportional to the rf power spectral density. But if the 
voltage were proportional to the frequency or phase of the oscillator, then the 
result of the measurement would be proportional to the spectral density of 
the frequency or phase. The most common units of S,{ f) are radians squared 
per hertz. 

Alternatively. the spectral density can be obtained by digital analysis of the 
signal. For example, the quantity S,(f) can be calculated from the Fourier 
transform of x(t). The relevant continuous Fourier-transform pair is defined 
as follows: 


« 
xis) -{ x(en2? de (12-13) 


and 
le 
= idepe 2» 
x(t) ‘ _ Ue df. (12-14) 


However, one does not generally have continuous knowledge of the phase of 
the oscillator. Since it is relatively easy to measure x(t) at equally spaced time 
intervals, we assume the existence of the series x,, where x, = x(It) for integer 
values of |. The discrete Fourier transform is defined by analogy to the 
continuous transform (Cochran et al., 1967): 


- ; 
XN= Y xAew?s, (12-15) 
ere 
In practice the time series has finite length T consisting of N intervals of 
length rt, and it is not possible to compute the infinite sum. Nevertheless, it 
remains possible to compute a spectrum that is not continuous inf but rather 
has resolution Af, where 


Af = WT= Nr. (12-16) 


The need to sum over all values of the index / is removed by assuming that the 
function x(t) repeats itself with period T. The resulting spectrum contains no 
information on the spectrum at Fourier frequencies less than 17. Truncation 
of the time series also introduces spurious effects due to the turn-on and turn- 
off transients. These problems can be minimized through the use of a window 
function. The computed spectrum is actually the square of the magnitude of 
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the window function multiplied by the desired spectrum. The use of a window 
function reduces the variance of the spectrum estimate at the expense of 
smearing out the spectrum to a small degree. With these changes but no 
window function, we arrive at the discrete finite transform 


Net 
X(ndf) = + Esker, (12-17) 
oA 


The spectral density of x(t) is computed from Eq, (12-17) by squaring the real 
and imaginary components, adding the two together, and dividing by the 
total time T: 


(REX(m fy)? + ULXim af)? 
r : 


The digital method of estimating spectral densities has many advantages 
over analog signal processing. Most important is the fact that it may be 
computed from any set of equally spaced samples of a time series. As a result, 
the technique is compatible with other methods of characterizing the signal, 
that is, the sampled data can be stored and processed using a variety of 
algorithms. In addition, each record of length T produces a single estimate of 
the spectrum for each of the N frequencies Af 2 Of....,N Af. It is therefore 
possible to estimate the entire spectrum much more quickly using the digital 
technique than it would be using analog methods. The fast Fourier 
transform, a very efficient algorithm for the computation of the discrete finite 
transform, has opened the way io versatile self-contained, commercial 
spectrum analysis. It is also very straightforward to compute the spectrum 
from data acquired by computerized digital data acquisition systems. 

A result of the finite sampling rate is that the upper frequency limit of the 
digital spectrum analysis is 1/2:, called the Nyquist frequency (Jenkins and 
Watts, 1968). Power in the signal being analyzed that is at frequencies higher 
than the Nyquist frequency affects the spectrum estimate for lower frequen- 
cies. This problem is called aliasing. The out-of-band signal is rejected by 
only approximately 64B per octave above the Nyquist frequency. Thus, 
when significant out-of-band signals exist, they must be reduced by analog 
filtering. One or more low-pass filters are usually sufficient for this purpose. 

As its second measure of frequency stability, the IEEE recommended the 
sample variance o}{t) of the fractional-frequency fluctuations. It is a measure 
of the variability of the average frequency of an oscillator between two 
adjacent measurement intervals. The average fractional-frequency deviation 
J, over the time interval from 1, to 1, + t is defined as 


Sm Af) = (12-18) 


mee 
j= tf Ho dt, (12-19) 
tly 
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x(t) 


FIG 12-3 Measurement process for the computation of the sample variance. The phase 
difference between two oscillators is plotted on the ordinate. The measurement yields a set of 
frequencies averaged over equal intervals r separated by dead time T- 


from which it follows that 


j= Mt ail (12-20) 

The quality ¢ is often referred to as the sampling time or the averaging time 
Equations (12-19) and (12-20) are not the only way to define mean frequency, 
but they are the simplest. Other definitions lead to alternative measures of 
stability that may have desirable properties. 

Suppose that one has measured the time or frequency fluctuations between 
a pair of precision oscillators and a stability analysis is desired. The process is 
illustrated in Fig. 12-3. These are N values of the fractional frequency j,. 
Each one is measured over a time t, and measurements are repeated after 
intervals of time T. If the measurement repetition time exceeds the averaging 
time, then there is a dead time equal to T—t between each frequency 
measurement, during which there is no information available. 

There are many ways to analyze these data. A fairly general approach is the 
N-sample variance defined by the relation 


1 & rao? 
WN, =(~— F (nego d 2.2 

CoA, T. 1) (y =a £( aD) . (12-21) 
where the angie brackets denote the infinite time average. Frequently, Eq. 
(12-21) does not converge as N — x, since some noise processes in oscillators 
diverge rapidly at low Fourier frequencies. This implies that the precision 
with which one estimates the variance does not improve simply as the sample 
size is increased, For this reason, the two-sample variance with no dead time 
is preferred. Also called the Allan variance, it converges for all the major 
Noise types observed in precision oscillators. [t may be written as 


ott) = CHie-1 — Fa)?- (12-22) 
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FIG. 12-4 N-sample variance versus Altan variance, The two-sample variance converges for 
the important types of noise observed in frequency standards but the ratio of the traditional 
variance to the two-sample variance is an increasing function of sample size for flicker frequency 
noise and random-walk frequency noise. 


The dependence of the classical variance on the number of samples is shown 
in Fig. 12-4 for the case of no dead time. The quantity plotted is the ratio of 
the N-sample variance to the Allan variance. Note that a3(r) has the same 
value as the classical variance for the white-noise frequency modulation. 
However, the classical variance grows without bound for flicker-frequency 
and random-walk-frequency noises. 

One may combine Eqs. (12-20) and (12-22) to obtain an equation for ¢,(t) 
in terms of the time-difference or time-deviation measurements: 


ot) = Che -FE x(t + 2t) — Axfe + 1) + X(N. (12-23) 
N discrete time readings may be used to estimate the variance 
1 N-2 
ait) Nope z (x22 — 2x05 + x7, (12-24) 


where i denotes the number of the measurement in the set of N and the 
nominal spacing between measurements is t. Since it has been assumed that 
there is no dead time between measurements, one can write t in Eq. (12-24) as 
an integer multiple of to. that is. t = mito, where to is the smallest spacing of 
the data. In this case 

N-im 


1 
2, = =- 2x, 2-2: 
a;(mto) = UN = ommte sf 2 (Xicam — 2Xiem +X (12-25) 
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12.1.3 The Concepts of the Frequency Domain and the Time Domain 


Spectral densities are measures of frequency stability in what is called the 
frequency domain since they are functions of Fourier frequency. The Allan 
variance, on the other hand, is an example of a time-domain measure. In a 
strict mathematical sense, these two descriptions are connected by Fourier 
transform relationships (Cutler and Searle, 1966). However, for many years 
the inadequacy of measurement equipment created artificial barriers between. 
these two characterizations of the same noise process. As a result, many 
specialized techniques have been developed to translate between the various 
measures of stability (Allan, 1966: Burgoon and Fischer, 1978). The preceding 
sections have demonstrated how easily both types of stability measures can 
be computed from the same data provided that the measurement process 
provides complete information. For example, both o}(mto) and S,(m Af) can 
be computed from evenly spaced samples of x(r). However, incomplete 
information can result from either measurement dead time or interruptions in 
the data acquisition process. In these cases translation techniques remain 
valuable. 

Both the spectral density and the Allan Variance are second-moment 
measures of the time series x(t). However, it is only possible to translate 
unambiguously from the spectral density to the Allan variance, not the 
reverse, To calculate the spectral density it is necessary to use the autocor- 
relation function of the phase. The following discussion on power-law noise 
processes further demonstrates this dichotomy. As we shall see, the Allan 
variance for a fixed measurement bandwidth does not distinguish between all 
of the noise processes that are commonly observed in precision oscillators. 


12.1.4 Translation between the Spectral Density of Frequency 
and the Allan Variance 


The power-law model is most frequently used for describing oscillator 
phase noise. It assumes that the spectral density of frequency fluctuations is 
equal to the sum of terms, each of which varies as an integer power of 
frequency. Thus, there are two quantities that completely specify Sf) for a 
particular power-law noise process: the slope on a log-log plot for a given 
range of f and the amplitude. The slope is denoted by x and therefore f? is the 
straight line on a log-log plot that relates S,{ f) to f. The amplitude is denoted 
h,. When we examine a plot of the spectral density of frequency fluctuations, 
we represent it by the addition of all the power-law processes (Allan, 1966: 
Vessot et al., 1966) with the appropriate coefficients: 


sine ES hS. 112-26) 
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TABLE 12-1 
Correspondence between Common Power-Law Spectral Densities and the 
‘Allan Variance* 
Noise type Su) oie 
White phase nf Yahya? 
Flicker phase nS 
‘White frequency he 
Flicker frequency oy 


Random-walk frequency Ce H2ayh_at 


* Where necessary for convergence the spectral density has been assumed to 
be zero for frequencies greater than the cutoff frequency f,. 


This technique is most valuable when only a few terms in Eq. (12-26) are 
required to describe the observed noise and each term dominates over several 
decades of frequency. This situation often prevails. Five power-law noise 
processes (Allan, 1966: Vessot er al., 1966) are common with precision 
oscillators: 


(1) random-walk frequency modulation a=-2 


(2) flicker frequency modulation a=n-l 
(3) white frequency modulation a=0 
(4) flicker phase modulation a=] 
(5) white phase modulation a=m2 


The spectral density of frequency is an unambiguous description of the 
oscillator noise. Thus, the spectrum can be used to compute the Allan 
variance (Barnes er al., 1971): 


efits j Seif) sin“(axte) df. (12-27) 
(rv9z)" Jo 


However, Eq. (12-27) shows that the Allan variance is very sensitive to the 
high frequency dependence of the spectral density of phase, thereby neces- 
sitating a detailed knowledge of the bandwidth-limiting elements in the 
measurement setup. The integral has been computed for each of the power- 
law noise processes, and the results are summarized in Table 12-1 (Barnes er 
al,, 1971), For xin the range —2 < a < 0, the Allan variance is proportional 
to t*, where » = —a2 — 1. When the log of the Allan variance is plotted as a 
function of the log of the averaging time, the graph also consists of straight- 
line segments with integer slopes. However, Table 12-1 also shows that even if 


‘See Appendix Note # 5 
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the oscillator is reasonably modeled by power-law spectra, it is not practical 
to distinguish between white phase noise and flicker phase noise from the 
dependence of the Allan variance on t. In both cases o} = 1/t. 


12.1.5 The Modified Allan Variance 


Table 12-1 also shows that the Allan variance has very different bandwidth 
dependence for white phase noise and flicker phase noise. Therefore, these 
noise types have been distinguished by varying the bandwidth of the 
measurement system. If x(r) were measured, the noise type could be identified 
by computing the spectrum. However, both the approach of making 
measurements as a function of bandwidth and the computation of the 
spectrum can be avoided by calculating a modified version of the Allan 
variance. The algorithm for this variance has the effect of changing the 
bandwidth inversely in proportion to the averaging time (Snyder, 1981; Allan 
and Barnes, 1981). 

Each reading of the time deviation x, has associated with it a measurement- 
system bandwidth f, . Similarly, we can define a software bandwidth, = f,'n, 
which is 1/n times narrower than the hardware bandwidth. It can be realized 
by averaging n adjacent x,'s. Based on this idea it is possible to define a 
modified Allan variance that allows the reciprocal software bandwidth to 
change linearly with the sample time t: 


mod o(t) = m(i 5 tists = Bitieat v}). (12-28) 
jet 


Equation (12-28) reduces to Eq. (12-23) forn = 1. One can see 
is the second difference of three time values, each of which is a 
nonoverlapping average of n of the x,’s. As n increases the software 
bandwidth decreases as f,/n. 

For a finite data set of N readings of x, (i = 1 to N), mod a(t) can be 
estimated from the expression 


where t = nz, 


1 N-3art aejnd e 
Naresh A, z% (jean — 2,00 + 40%, 
(12-29) 
which is easy to program but takes more time to compute than the 
corresponding equation (12-24) for ¢}(z). 
Table 12-2 gives the relationship between the time-domain measure 
mod ¢3(r) and its power-law spectral counterpart. In the right-hand column 


are the asymptotic values of the ratio of the modified Allan variance to the 
Allan variance. It is clear from the table that mod ¢3(t) is very useful for white 


= See Appendix Note # 9 
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TABLE 12-2 


Correspondence berween Common Power-Law Speciral Densities and the Modified Allan 
Variance* 


Noise type sun mod e}t) mod e3/e? 
White phase as? hy aah a 
(1.038 + 3 lei2af,1)) 1 
Flicker phase nS — Sa 1 
White frequency he hg At os 
Flicker frequency hase h-,(0.936) 0.674 
Random-walk frequency haf"? ha (5.42 0824 


* Where necessary the spectral density has been assumed to be zero for (requencies greater than 
the cutoff frequency f . The constant n ir the number of adjacent phase values that are averaged 
to produce the bandwidth reduction. The values in the last two columns are for the asymptotic 
limit n = x. In practice, n only needs to be 10 or larger before the asymptotic limit is approached 
within a few percent. When m = I the ratio in the last column is | in all cases. 


phase modulation and flicker phase modulation, but for x <1 the con- 
Ventional Allan variance gives both an easier-to-interpret and an easier-to- 
calculate measure of stability. 

It is interesting to make a graph of x versus y for both the ordinary Allan 
variance and the modified Allan variance, such as the one shown in Fig. 12-5. 


t = | 


FIG. 12-5 Relationship between a power-law spectral density whose slope on a log-log plot 
is x and the corresponding sample variance whose slope on a log-log plot is . The solid line 
describes the behavior of the Allan variance, while the dashed line shows the advantage of the 
modified Allan variance for white phase noise and flicker phase noise. 
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This graph allows one to determine power-law spectra for noninteger as well 
as integer values of z. In the asymtotic limit the equation relating p and 2 for 
the modified Allan variance is 


a=-y-l for ~3<2<3. (12-30) 


12.1.6 Determination of the Mean Frequency and Frequency Drift 
of an Oscillator 


Before the techniques of the previous four sections can be meaningfully 
applied to practical measurements, it is necessary to separate the deter- 
ministic and random components of the time deviation x(r). Suppose, for 
example, that an oscillator has significant drift, such as might be the case for a 
quartz crystal oscillator. With no additional signal processing. the Allan 
variance would be proportional to r?. The variance of the Allan variance 
would be very small, further demonstrating that deterministic behavior has 
been improperly described in statistical terms and the oscillator's predict- 
ability is much better than the Allan variance indicated. Unfortunately, it 
is difficult to estimate the oscillator's deterministic behavior without intro- 
ducing a bias in the noise at Fourier frequencies comparable to the inverse 
of the record length. In practice, it has been sufficient to consider two 
deterministic terms in x(t): 


X(t) = Xq + (Avivo)t + 4DE + x,(0) (12-31) 


The first term on the right-hand side is the synchronization error. The second 
term is due to imperfect knowledge of the mean frequency and is sometimes 
called syntonization error. The quadratic term, which results from frequency 
drift, is the most difficult problem for the statistical analysis because the Allan 
variance is insensitive to both synchronization and syntonization errors. 

For white noise, the optimum estimate of the process is the mean, 
Therefore, a general statistical procedure that can be followed is to filter the 
data until the residuals are white (Allan er al., 1974: Barnes and Allan, 1966), 
For example. at short times the frequency fluctuations of atomic clocks are 
usually white. Taking the first difference of Eq. (12-31), we find that 


Xe + t) — xl 
ee 
‘0 


(12-32) 


and a linear least square fit to the frequency data yields the optimum estimate 
of Av. However, the drift in atomic clocks is generally so small that the value 
obtained for D will not be statistically significant when ¢ is small enough to 
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satisfy the assumption of white frequency noise. Thus, we are led to consider 
the first difference of the frequency, 


NMe+ SN 5 
t tT 


X(t + 2t) — Pile ++ x(t) (12-33) 


Many atomic clocks are dominated by random walk of frequency noise for 
long averaging times. Thus, the first difference of the frequency data (the 
second difference of the phase data) is white, and the optimum estimate of the 
drift is just the simple mean. If instead, a linear least square fit were removed 
from the frequency data in this region of t, then the random-walk residuals 
would be biased, and it is likely that an optimistic estimate of ¢,(t) would be 
obtained. 

The optimum procedure would be different if the dominant noise type 
were flicker of frequency, rather than random walk. But there is no simple 
prescription that can be followed to estimate the drift in that case. 
Fortunately, a maximum likelihood estimate of the prameters for some 
typical cases has shown that the mean second difference of phase is still a 
good estimator of frequency drift in the sense that it introduces negligible bias 
in the Allan variance, Thus, in practice there is a simple prescription for 
computing the Allan variance in the presence of significant drift. Starting 
with the phase data, one forms the second difference and uses the simple 
average 10 estimate the mean, The value of ¢ chosen for creating these second 
differences must be long enough so that the predominant noise process is 
random-walk frequency modulation. After subtracting this estimate, the 
second-difference data 1s integrated twice to recover phase data with drift 
removed, and further analysis, including the computation of the Allan 
variance, may proceed. Figures 12-6 through 12-10 illustrate the estimation 
of drift. The quadratic dependence of the phase data in Fig. 12-6 nearly 
obscures the noise. The first difference of this data produces the nearly linear 
frequency dependence shown in Fig, 12-7, and the second difference produces 
the residuals shown in Fig. 12-8, which appear to be nearly white. Rigorous 
statistical analysis of this data indicates that the first difference of the 
frequency is indeed white with 90°, confidence. Next, the mean frequency 
difference is subtracted. Then the residuals of Fig. 12-8 are integrated twice, 
and the result is the estimate of the phase deviation with drift removed shown 
in Fig 12-9 Fig. 12-10 illustrates the Allan variance of this data calculated by 
three techniques. The squares were computed from the data of Fig, 12-6, 
while the open circles were computed following the recommended procedure 
for estimating the drift. The validity of the approach is illustrated by the black 
dots, which are the result of a statistically optimum parameter estimation 
procedure. 
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FIG. 12-6 Measured phase difference between a frequency standard and a reference during 
a 14-day experiment. The nearly quadratic form of the data effectively obscures the noise. 
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FIG 12-7 One-day frequency averages obtained by taking the first differences of the data in 
Fig 12-6. The ordinate is the fractional difference of the daily frequency from a nominal value, 
The nearly linear change in frequency with time is apparent, although the random deviations are 
visible 


js 
——J 


Tae 


FREQUENCY DIFFERENCE 


TIME (DAYS) 


FIG 12-B Second difference of the data in Fig. 12-6 The second difference operation has 
removed the nonrandom behavior and the residuals appear to be nearly white, 
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FIG. 12-9 Phase variations of the frequency standard due to the residuals. obtained by 
performing two integrations on the data of Fig. 12-8. The ordinate scale is expanded 
approximately 10 times compared to Fig. 12-6. 
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FIG 12-10 Logarithm of the square root of the Allan variance as a function of the 
Joganthm of the averaging ume for three different computation methods. The squares were 
computed from the data of Fig 12-6 and show the effect of the drift. The open circles were 
computed from the data of Fig. 12-9. The closed circles were computed using an optimum- 
parameter estimation procedure. 


12.1.7 Confidence of the Estimate and Overlapping Samples 


Consider three phase or time measurements of one oscillator relative to 
another at equally spaced intervals of time, From this phase data one can 
obtain two adjacent values of average frequency and one can calculate a 
single sample Allan variance (see Fig. 12-11). Of course, this estimate does not 
have high precision or confidence, since it is based on only one frequency 
difference. 

For most commonly encountered oscillators, the first difference of the 
frequency is a normally distributed variable with zero mean. However, the 
square of a normally distributed variable is not normally distributed. This is 
so because the square is always positive and the normal distribution is 
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x) 


FIG. 12-11 Calculation of two average frequencies J, and j, by measuring the phase of an 
oscillator x(t) at times f,. ¢3, and f,. 


completely symmetric, with negative values being as likely as positive ones. 
The resulting distribution is called a chi-squared distribution, and it has one 
“degree of freedom” since the distribution was obtained by considering the 
squares of individual (i.e, one independent sample), normally distributed 
variables (Jenkins and Watts, 1968). 

In contrast, from five phase values four consecutive frequency values can 
be calculated, as shown in Fig. 12-12. It is possible to take the first pair and 
calculate a sample Allan variance. A second sample Allan variance can be 
calculated from the second pair (i.¢., the third and fourth frequency 
measurements). The average of these two sample Allan variances provides an 
improved estimate of the true Allan variance, and one would expect it to have 
a tighter confidence interval than in the previous example. This could be 
expressed with the aid of the chi-squared distribution with two degrees of 
freedom. 

However, there is another option. One could also consider the sample 
Allan variance obtained from the second and third frequency measurements, 
that is, the middle sample variance. This last sample Allan variance is not 
independent of the other two, since it is made up of parts of each of the others. 
But this does not mean that it cannot be used to improve the estimate of the 
true Allan variance. It does mean that the new average of three sample Allan 
variances is not distributed as chi squared with three degrees of freedom. The 
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FIG 12-12 Calculation of four frequency values j,. J;. 5,. and J, from five phase 
measurements at times ¢,. f2. f5. 4. and f,. The sample variance formed from j, and j, and the 
cone formed from j, and J, are independent. The sample variance formed from j; and j, is not 
independent of the other (wo but does contain some additional information useful in estimaung 
the true sample vanance 
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number of degrees of freedom depends on the underlying noise type, that is, 
white frequency, flicker frequency, etc. and may have a fractional value. 

Sample Allan variances are distributed as chi square according to the 
equation 


x = (df)sz/o}, (12-34) 


where s} is the sample Allan variance, df the number of degrees of freedom 
(possibly not an integer), and o? the true Allan variance, which we are 
interested in knowing but can only estimate imperfectly. 

The probability density for the chi-squared distribution is given by the 
relation (Jenkins and Watts, 1968) 


1 
2) 2y8t/2~ 19> 24/2 - 
0) = sararap ates, (12-35) 
where I'(df/2) is the gamma function, defined by the integral 
Tw) -[ xe" * dx, (12-36) 
° 


A typical distribution is shown in Fig. (12-13). 

Chi-squared distributions are useful in determining confidence intervals for 
variances and standard deviations, as shown in the following example. 
Suppose one has a sample variance s? = 3.0 and it is known that this 
variance has 10 degrees of freedom. The object is to calculate a range around 
the sample value of s? = 3.0 that probably contains the true value 03. The 
desired confidence is, say, 90°. That is, 10% of the time the true value will 
actually fall outside of the stated bounds. The usual way to proceed is to 
allocate 5°, to the low end and 5%, to the high end for errors, leaving 90°, in 
the middle. This is arbitrary and a specific problem might dictate a different 
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FIG. 12-13 Approximate form of a typical chi-squared distribution. For 10 degrees of 


freedom. 5°, of the area under the curve corresponds to values of z* less than 3.94, and an 
additional 3%, corresponds to values of x? greater than 18.3. 
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allocation. By referring to tables of the chi-squared distribution, one finds 
that for 10 degrees of freedom (df = 10) the 5%, and 95%, points correspond to 

7(0.05) = 3.94, (0.95) = 18.3. (12-37) 


Thus, with 90°, probability the calculated sample variance s} = 3 satisfies the 
inequality 


3.94 < (df)s?/o2 < 18.3, (12-38) 
and this inequality can be rearranged in the form 
1.64 < 03 < 7.61. (12-39) 


The estimate s? = 3 is a point estimate. The estimate 1.64 < 6} < 7.61 is 
an interval estimate and should be interpreted to mean that 90% of the time 
the interval calculated in this manner will contain the true o}. 


12.1.8 Efficient Use of the Data and Determination of the 
Degrees of Freedom 


Typically, the sample variance is calculated from a data set using the 
relation 


1 


25 


x 
LG 2, (12-40) 
pry 


where it is implicitly assumed that the =,’s are random and uncorrelated (i... 
white) and where is the sample mean calculated from the same data set. If all 
of this is true, then s? is chi-squared distributed and has N — 1 degrees of 
freedom. 

Consider the case of two oscillators being compared in phase with N values 
of the phase difference obtained at equally spaced intervals tg. From these N 
phase values one obtains N — | consecutive values of average frequency, and 
from these one can compute N — 2 individual sample Allan variances (not all 
independent) for t = to. These N — 2 values can be averaged to obtain an 
estimate of the Allan variance at t = to. 

The variance of this Allan variance has been calculated (Lesage and 
Audoin, 1973. Yoshimura, 1978). This approach is less versatile than the 
method of the previous section since it yields only symmetric error limits. 
However, it is simple and easy to use. Let A(N) be the relative difference 
between the sample Allan variance and the true value. Thus, 


s} = [1 + A(N)Jo3{r). (12-41) 


TN-83 


214 SAMUEL R. STEIN 


TABLE 12-3 


Variance of the Relative Diflerence between the Sample 
Allan Variance and the True Value (C,/N)* 


Noise type « G 
White phase 2 388 
Flicker phase 1 388 
White frequency C) 299 
Flicker frequency -1 231 
Random-walk frequency -2 225 


* N is the number of phase measurements. The result is 
accurate to better than 10°, for N larger than 10. 


The quantity A(N) has mean zero. For N larger than 10, the variance of A is 
approximately 

aA) = CN. (12-42) 
Table 12-3 gives the constant C, for the five major noise types. 

Using the same set of data it is also possible to estimate the Allan variances 
for integer multiples of the base sampling interval t = mto. Now the 
possi ies for overlapping sample Allan variances are even greater. For a 
data set of N phase points, one can obtain a maximum of exactly N — 2m 
sample Allan variances for t = mt. Of course only (N — 1) 2m of these are 
generally independent. Still, the use of all of the data is well justified since the 
confidence of the estimate is always improved by so doing. Consider the case 
of an experiment extending for several weeks in duration with the aim of 
getting estimates of the Allan variance for t values equal to a week or more. 
As always, the purpose is to estimate the “true” Allan variance as well as 
possible, that is, with as tight an uncertainty as possible. Thus, one wants to 
use the data as efficiently as possible. The most efficient use is to average all 
possible sample Allan variances of a given t value that one can compute from 
the data. This procedure is illustrated in Fig. 12-14. 

In order to calculate confidence intervals for a sample variance, it is 
necessary to know the number of degrees of freedom. This has been done by 
both analytical and Monte Carlo techniques, and empirical equations have 
been found that are accurate to 1% for white phase, white frequency, and 
random-walk frequency modulation. The tolerance is somewhat larger for 
flicker frequency and phase modulation (Howe et al., 1981). The empirical 
equations for the degrees of freedom are given in Table 12-4. Table 12-5 gives 
the degrees of freedom for selected values of N, the total number of phase 
values, and m, the number of intervals averaged. Figure 12-15 illustrates the 
number of degrees of freedom for all noise processes as a function of t for the 
case of 101 total phase measurements. 
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FIG 12-14 __Illusteation of the case of + = 4t9. for which the ratio of the aumber of fully 
overlapping to nonoverlapping estimates of the variance is more than 8 for the 57 phase points 
shown. When the averagng time for the computation of mean frequencies 1 exceeds the 
sampling time to, the number of fully overlapping mean frequencies is far larger than the number 
of nonoverlapping frequencies. In general, for large N approximately 2m umes as many 
estimates of the sample variances can be computed using the fully overlapping technique 


TABLE 12-4 


Number of Degrees of Freedom for Calculation of the Confidence of the 
Estimate of a Sample Allan Variance’ 


Noise type ar 
(N + 1KN = 2m) 
Whi ——_—_ 
apt AN - m) 
N=1), (Om + 1K = 19) 
Flicker phi SS le 
licker phase evi = ) ol 7 )] 
2) 4m? 
Whute frequency ed ee 
Flicker frequency form=1 
eh 2 
yea Nee 
2(N = 1) = 3miN = 1) = 4m? 


Random-walk frequency 


* For: = mzy from N phase points spaced 7, apart 


TN-85 


216 SAMUEL R. STEIN 


TABLE 12-5 


Number of Degrees of Freedom for Calculation of the Confidence of the Estimate of a Sample 
Allan Variance for the Major Noise Types” 


White Flicker White Flicker Random-walk 
N m phase phase frequency frequency frequency 
9 1 3.665 4335 4.900 6.202 7.000 
2 3.237 3.937 3448 3.375 2.866 
4 1,000 1.000 1,000 1,000 0.999 
129 1 65.579 79.015 84.889 110.548 127.000 
2 64.819 (66.284 71.642 77.041 62.524 
4 63.304 52.586 42.695 8 29.822 
8 60.310 37.06 21.608 16.994 13.567 
16 $4,509 22.347 9.982 7.345 5.6 
32 44.761 9.986 4.026 2.889 2.047 
oy 1.000 1,000 1.000 1.000 1.000 
1025 1 $26.373 625.071 682.222 889.675 1023.000 
2 $43.863 83.622 636.896 510.502 
4 459.041 354,322 316.605 253.755 
8 366.113 186.363 156.492 125.395 
16 269.849 93.547 76.495 61.241 
32 179.680 45.947 36.610 29.210 
o 104.743 21.997 16.861 13.268 
128 50.487 10.003 7.281 5.516 
256 354.914 17.429 4.003 2.361 2.005 
S12 1.000 1.000 1.000 1.000 1.000 


* Nis the number of equally spaced phase points that are taken mat a time to form the averaging 
time. 


12.1.9 Separating the Variances of the Oscillator and the Reference 


A measured variance contains noise contributions from both the oscillator 
under test and the reference. The individual contributions are easily sepa- 
rated if it is known a priori that the reference is much less noisy than the 
device under test or equal to it in performance. Otherwise, the individual 
contributions can be estimated by comparing three devices (Barnes, 1966). 
The three possible joint variances are denoted by 0}. 4, and o3, while the 
individual device variances are c?, ¢?, and o?. The joint variances are 
composed of the sum of the individual contributions under the assumption 
that the oscillators are independent: 


of =o) +43, 
oh =} + 3. (12-43) 


ok = a? + aj. 
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FIG. 12-15 Number of degrees of freedom as a function of averaging time for the case of 101 
phase measurements: The heavy broken line is for random-walk frequency noise, the light 
broken line is for flicker frequency noise. the dotted Line is for white frequency noise, the heavy 
solid line is for flicker phase noise. and the light solid line is for white phase noise, 


An expression for each individual variance is obtained by adding two joint 
variances and subtracting the third; 


a? = {Mo} + 0, — 03), 
a} = Ho}, + 03 - 3), (12-44) 
of = i(03, + 3, — o}). 


This method works best if the three devices are comparable in performance. 
Caution must be exercised since Eqs. (12-44) may give a negative sample 
Allan variance despite the fact that the true Allan variance is positive definite. 
This is possible because the confidence interval of the estimate is sufficiently 
large to include negative variances. Such a result is an indication that the 
confidence intervals of the sample Allan variances are too large and that 
more data is required. 


12.2 DIRECT DIGITAL MEASUREMENT 


12.2.1 Time-Interval Measurements 


A common technique for measuring the phase difference between oscil- 
lators having nearly equal nominal frequencies is the use of direct time- 
interval measurements. In this section and those that follow, the symbols v,9 
and v9 are used to indicate the nominal values of v, and v3, respectively. In 
the simplest form of this technique, a time-interval counter is started on some 
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FIG. 12-16 The phase difference measured by a time-interval counter is the phase difference 
between the start signal and the stop signal modulo the period of the stop signal 


arbitrarily selected positive-going zero crossing of the signal from one 
oscillator (started on v,9 at time f,) and stopped in the next positive-going 
zero crossing of the second oscillator (stopped on vo at time 3). The 
measured time difference is 


xa(t,) — xy(t)) = —Pr{l + (20 — Vi0)/*iokk (12-45) 


where P is the reading of the time-interval counter and t, the period of its 
time base (Allan et al., 1974). The units of the time difference is seconds of 
oscillator number 1. Equation (12-45) demonstrates an important character- 
istic of both time- and phase-difference measurements. Because of distortion 
the phase of an oscillator is generally not well known except at zero crossings. 
Thus, the quantity usually measured is x,(t;) — x,(t,). However, all analysis 
techniques require the phase difference at the same time, and the translation 
requires a correction that takes into account the difference in frequency 
between the two oscillators. This correction is the reason for the second term 
in the brackets on the right-hand side of Eq. (12-45). 

The simple scheme described above measures a maximum accumulated 
phase difference of one cycle of the signal, When the phase difference exceeds 
one cycle the counter reading is periodic, as shown in Fig. 12-16. This 
ambiguity can be reduced by dividing the signals from each oscillator before 
the time-interval measurement. The complete system is shown in Fig. 12-17. 
The effect of the divider is to increase the time interval before an ambiguity 


DIVIDER 


osciiiaton 


FIG 12-17 Schematic diagram of the dividers used in conjunction with a time-interval 
counter to increase the maximum measurable phase difference to N cycles of the stop signal. 
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occurs to N.'v,9, where N is the divisor. Such measurement systems are used 
at many standards laboratories for the long-term measurement of atomic 
clocks, whose output is usually divided down to 1 pulse/sec. Since time- 
interval counters with resolution better than 0.1 nsec are available, this 
measurement scheme is suitable for long-term performance monitoring, 
yielding frequency-measurement precision of 10~'* for 1-day averages. 


12.2.2 Frequency Measurements 


Average frequency is measured most directly using a frequency counter. 
Used this way, the counter determines the number of whole cycles M 
occurring during a time interval r given by the counter’s time base. Thus 


(0: t) = (M + AM)/t = M/t, (12-46) 


where Wiz,:1;) denotes the average frequency over the interval from ¢, to t; 
and AM, the fractional cycle, is not measured by the counter. The starting 
time is arbitrarily called ¢ = 0. Thus, the quantization error is given by 


Arg/<r> < 1M. (12-47) 


12.2.3. Period Measurements 


For low frequencies, the number of cycles counted may be small and the 
quantization error can be very large. By measuring the period instead of the 
frequency, it is possible to decrease the error without increasing the duration 
of the measurement. A period counter measures the duration of M whole 
cycles of the signal as N cycles of the time base t,. The fraction of a cycle AN 
is not measured. Thus, we have 


M = 0; M)voXN + AN)r,, (12-48) 
and therefore 
0: M/vo) = M'Nz, (12-49) 
and the quantization error is 
Avg/<v) < 1/N. (12-50) 


Frequency measurements are almost never used to characterize precision 
oscillators, but period measurements are very common. A straightforward 
extension of this method eliminates the bias potentially introduced by the 
quantization error and permits the measurement of accumulated phase. The 
counter must be capable of being read without halting the counting process, 
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FIG. 12-18 Two-counter system to eliminate dead time in period measurements The two 
counters alternately count the number of cycles of the time base in N penods of the oscillator 
under test. 


Alternatively, a second counter may be used to begin counting the same time 
base when the first counter stops. The second approach is illustrated in Fig. 
12-18. This type of measurement system is sometimes called a chronograph. 


12.3 SENSITIVITY-ENHANCEMENT METHODS 
12.3.1 Heterodyne Techniques 


It is possible for oscillators to be very stable. and values of ¢,{t) can be as 
small as 107'* in some state-of-the-art standards. Thus, one often needs 
measuring techniques capable of resolving very small fluctuations in 11), One 
of the most common techniques is the heterodune or beat-frequency 
technique. In this method the signal from the oscillator under test is mixed 
with a reference signal of almost the same frequency so that one is left with a 
lower average frequency for analysis without reducing the frequency (or 
phase) fluctuations themselves. 

In principle, it is possible to analyze the most general measurement case, 
where no restrictions are placed on the average frequency or phase difference 
between the two oscillators under test. Equation 12-1 can be inverted as 

2rvot + dit) = arcsin[F(r)/Vo) (12-51) 
and used to obtain the series d(mz=) by sampling the voltage at regular time 
intervals. This direct technique is not used, because it requires unobtainable 
mixer performance characteristics. The high-level rf signals that are required 
for low-noise phase measurements produce significant harmonic distortion, 
so that the output of the phase detector deviates significantly from a sine 
wave. Furthermore, the distortions are generally sensitive to level and 
environmental perturbations. However, the phase relationships among the 
various harmonics are very stable, so it is possible to use the repetition of one 
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point on the waveform in order to count cycles. The positive-going zero 
crossings are normally chosen in order to provide immunity from changes in 
both the amplitude and symmetry of the waveform. 

Consider two signals whose frequency difference is much less than the 
frequency of either oscillator: 


Vil) = Viosin{2aviot + G4(0) + $10] 
and (12-52) 
V,(0) = Vio sin[2nvzot + $210) + $20), 
where |v¥;9 — ¥zol € ¥49 and the constants $9 and $29 represent the nominal 
phases of the two signals. 

Suppose that the two signals are mixed in a linear product detector and 
filtered so that the signal at the sum frequency ¥,9 + ¥2o is highly attenuated. 
The result is 

V(t) = Vo cos[2nlvig — Vaolt + dio — $20 + Gilt) — H3lN], (12-53) 
which may be characterized by any of the measurement techniques discussed 
in Section 12.2. The amplitude V4 of the mixer output is a function of the 


mixer design, the input amplitudes, and the output termination (Walls et al., 
1976), Using the definition (12-10), we find that for the heterodyned signal 


Xyl0) = (1/2xvy) AG(0), (12-54) 
where 
%4 = "10 = Ya0l (12-55) 
and 
AG) = O10) — $2(0. (12-56) 
Equation (12-54) may be rewritten as 
ult) = (vo/Vud X(t), (12-57) 


from which we conclude that a given phase change corresponds to a larger 
time deviation for the heterodyne signal than for the original signal. As a 
result, the quantization error for the period measurement technique is 
reduced by the factor vy4/vq. 


12.3.2 Homodyne Techniques 


The limit of the heterodyne method, called homodyne, occurs when 
Yio = Yao. In this case the output of the phase detector is given by 


Vit) = Vo coslbio — 620 + Gilt) — 10). (12-38) 


‘© See Appendix Note # 6 
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The analysis of phase noise is accomplished by arranging that 
10 — $20 = 2/2, which can be achieved with a phase shifter. Then, 


Vit) & —Vo sin[d,(0) — $2(t)) = Voldalt) — di (t)). (12-59) 


There are various methods by which one can control the signal V;(r) so that 
Yi9 ™ Yzo Without producing significant correlation between ¢,(!) and 9,(1). 
When any one of these methods is used, it is possible to use V(t) as a measure 
of $(t). Two methods, delay lines and phase-locked loops (Gardner, 1966), are 
described below. 


12.3.2.1_ DISCRIMINATOR AND DELAY LINE 


The circuit of a discriminator or delay-line system for measuring phase 
noise is illustrated in Fig. 12-19. The delayed signal is given by 


Valt) = Vile — t4) = Vao sin[2xv, oft — ta) + Olt — te) + b10 + %)- 
(12-60) 
When the phase shifter is set for quadrature, @, — 2n¥,9fg = m2 and 
Vy(t) = Vzo sin[2xv, ot + Olt — t4) + dro + 2,2). (12-61) 
The output of the phase detector is given by 
Vit) = Voloilt — ta) — 401). (12-62) 
Substituting Eq. (12-62) into Eq. (12-20), we obtain 
Kt — tg: 0) = —Vi0) 2avgVots (12-63) 


and we see that the delay-line method can be used to produce samples of 
Smt) by varying the delay time. However, the technique is used more 
frequently with a fixed delay by restricting its application to the region of r 
much greater than the delay time, so that f(t — tq: t) is a good approximation 
for the instantaneous frequency. Under this assumption spectrum analysis of 


DISCRIMINATOR OR | Y2't) 
DELAY LINE 
PHASE 
DETECTOR 


FIG. 12-19 A delay-line phase-noise-measurement system. When the phase shifter is 
adjusted so that V(r) is im phase quadrature with Vath the output of the phase detector is 
approximately equal to the instantaneous frequency deviation of the oscillator. The spectral 
density of the source may be estimated for Fourier frequencies small compared to the inverse of 
the delay time 
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the signal from the mixer can be used to estimate the spectral density of the 
frequency fluctuations: 
1 
~ P x 
SID = Tee Vl) for f € l/nty. (12-64) 
Frequency discriminators are applied in an analogous fashion. A resonant 
circuit is often used to provide discrimination since it produces a phase shift 
proportional to the frequency deviation from the resonant frequency. For 
example, the phase shift on reflection from a resonance with loaded quality 
factor Q is 
@ = arctan(2Qy) = 2Qy, (12-65) 


provided that the frequency deviation is small compared to the bandwidth of 
the resonance and the applied signal is nearly at the center frequency of the 
discriminator. This can be accomplished either manually or with a frequency- 
locked loop. The design of such a loop is similar to the phase-locked loop of 
the next section. Once again, one can spectrum analyze the signal from the 
mixer to obtain 


1 
SI) = Bor Svvff) for f < v9Q. (12-66) 
The noise floor for measurements made with either a delay line or discrimi- 
nator normally results from white voltage noise in the analysis circuitry and 
is independent of the Fourier frequency. We denote the noise floor Sy», 
(minimum) and find the noise floor for frequency or phase measurements by 


2 2 
S,{noise limit) = Zi S,noise limit) = Foor Sy.y,(minimum). 
(12-67) 


Consequently, the discriminator or delay-line technique is limited in sensi- 
tivity since the output voltage is proportional to the frequency deviations. 
Greater sensitivity is possible using two oscillators in a phase-locked loop. 
The noise in the reference is an important consideration, even though the 
reference is passive in the case of a discriminator or a delay line. If the 
oscillator has sufficiently low noise, then the circuits described measure the 
variations of the discriminator center frequency or the delay variations in the 
delay line. 


12.3.2.2 PHASE-LOCKED LOOP 


The block diagram for the most general phase-locked loop that will be 
considered here is shown in Fig. 12-20. The noise voltage summed into the 
loop is a schematic way of representing ¢,(1), the open-loop phase noise of the 
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FIG. 12-20 Block diagram of a phase-locked loop. The order of the loop is determined by 
the Gilter transfer function. For convenience, noise in the oscillator under test is introduced at the 
‘summing junction. 


oscillator under test. Phase noise in the reference oscillator is denoted by 
Pratt). 

The purpose of using a phase-locked loop is simply to guarantee that the 
two oscillators are, on the average, in phase quadrature. When the oscillators 
are near quadrature, the voltage output of the phase detector is proportional 
to the difference in phase between the two output signals. 

Analysis of the phase-locked loop yields the result 


¥ 1 G,,(s) 
= —— eee -68 
ols) oil; re il + tl 7 alt (12-68) 
where G,,(s) is the open-loop transfer function defined by 


KoK4 Fis) 
s 


G.(s) = (12-69) 


and ¢,(s) and ¢,,)(s) are the Laplace transforms of the corresponding time- 

varying quantities. We can also calculate the voltage output of the phase 

detector, 

Kal Gres) — ,(5)] 
1+G,(s)” 

as well as the feedback voltage to the varactor, 


Vis) = (12-70) 


VAs) = Fists) = SE 4,.48) - 64101. (12-71) 
a3) 


Assuming that the phase noise of the two oscillators is not correlated, 


Ki . 
Sede) = GG pe Soni + Ses (12-72) 


07G,(jo)* 
S62) = TSS jont Soule) + $4 (0) (12-73) 
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FIG. 12-21. Circuit diagram of the most common loop filter for a second-order phase- 
locked loop. Resistor R, is required for stable operation. Capacitor C provides the low- 
frequency gain needed to reduce the phase errors of the first-order loop 
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FIG. 12-22 Bode plot for the loop filter of Fig. 12-21 


Je crw 


Thus, if we know the behavior of G,,( jo), then we can relate the measured 
spectrum of the voltage at the output of the phase detector or at the varactor 
tuner to the sum of the spectral densities of the phase noise of the two 
oscillators. 

The loop filter is often chosen to be a pure gain. The resulting first-order 
loop has a significant drawback: the two oscillators are offset from quadra- 
ture by a phase shift proportional to their open-loop frequency difference. In 
order to maintain system calibration, the operator must remove the fre- 
quency offset from time to time. This problem can be eliminated by using a 
second-order loop. Figure 12-21 illustrates one loop filter that can be used to 
achieve the desired frequency response. The transfer function of this filter is 


F(s) = (1 + st3)!st,, (12-74) 


where t,; = R,C and t, = R,C-. Figure 12-22 shows the Bode plot of the 
frequency-response function of this filter. Substitution of Eq. (12-74) into Eq. 
(12-69) yields the open-loop frequency-response function 


(12-75) 
where 
(12-76) 
and 
5 (12-77) 
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FIG. 12-23 Bode plot of the open-loop frequency-response function for a phase-locked loop 
having the loop filter of Fig. 12-21. Parameters were chosen to illustrate a stable condition. 


The first requirement to be satisfied by the loop parameters is that the 
closed loop be stable. Since the transfer function G,,(s) has no poles or zeros 
for s > 0, a sufficient requirement for the phase-locked loop to be stable is 
that the slope of the Bode plot of |G,q(jo»)] be less steep than —12 dB/octave at 
the point where |G,,(jw)| = 1. The Bode plot of |G,,(jw)| is shown in Fig. 
12-23 for a case where the loop operation is stable. 

It is desirable for the loop to be nearly critically damped, that is, [ = 1. At 
critical damping the natural frequency of the loop is related to rt, by 


g.z21 = 2/t3- (12-78) 
Under the same conditions the unity gain frequency is 
Oy gar = 4:12/t3. (12-79) 


The second requirement to be satisfied by the phase-locked loop is related 
to the accuracy with which spectral-density measurements can be made. 
Substitution of Eq. (12-75) into Eq. (12-72) yields 

Kjw* a 
Si(o) = Wrote do) + Sy (wi). (12-80) 
Since the proportionality factor has a high pass response, it is possible to use 
an essentially constant calibration to relate S,,(o) and S,(cw). For example, if 
we require that 
Sylo) = KalS,,,() + S,,(o] (12-81) 


with no more than 10% error for all Fourier frequencies greater than 
2n rad'sec, then for the critically damped loop the requirement on +; is 
Tz > 14sec. 
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The third requirement on loop performance is that the frequency offset 
between the two oscillators produce negligible phase shift of the oscillators 
from quadrature. In the ideal loop the phase error for a frequency error Av 
introduced at time ¢ = Ois 


error ™ 20 Ave eon, 


However, in the actual circuit there is a finite phase error due to the limited 
loop gain of the amplifier of Fig. 12-21. Nevertheless, the phase error is 
reduced by 10° compared to its value for a first-order loop. Typically, the 
error is less than the residual phase error due to the voltage offset at the mixer 
output and should be much less than 1°. 

The feedback loop reduces the sensitivity of the system for measurements 
of the phase spectral density for Fourier frequencies less than the unity-gain 
frequency of the phase-locked loop. One way to avoid this problem is to 
utilize the feedback voltage ¥,. Substituting Eq, (12-75) into Eq. (12-73), we 
find that 


2nviws — 452ww?) 
(or? = w2)? + Few? 


Sylo) = (S,,.0) + S, (oy). (12-82) 


For this case, the proportionality factor has a low pass response and a 
constant calibration factor may be used to relate Sy,(w) to Si). 


12.3.3 Multiple Conversion Methods 


Quite often the beat frequency between the signal under test and the 
laboratory reference is unsuitable or inconvenient for frequency-stability 
measurements. The frequency may be too high for the available counters or 
the heterodyne factor may be too small to yield the required noise enhance- 
ment. Under these circumstances a second mixing stage in series with the first 
can be used to produce the desired beat frequency. On the other hand, the 
direct beat frequency between two oscillators may be too small. For example, 
the frequencies of commercial cesium-beam frequency standards are usually 
so close together that the beat frequency between two devices would be near 
I cycle day, making it impossible to observe the stability at shorter times. 
This limitation can be overcome by the use of two parallel mixing stages. 


12.3.3.1 FREQUENCY SYNTHESIS 


A commercial frequency synthesizer is usually the most convenient way to 
produce arbitrary reference frequencies for stability measurements. A mixing 
stage preceding the synthesizer can be used both to bring the signal into the 
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FIG. 12-24 Use of frequency synthesis 10 measure oscillators whose frequency differs 
significantly from the available low-noise reference. It may be necessary 10 use a frequency 
multiplier to bring the signal into the range of the available synthesizer or to overcome the 
synthesizer's phase noise 


appropriate range and to enhance the oscillator noise compared to the short- 
term phase noise of the synthesizer. Figure 12-24 demonstrates both aspects 
of the technique. 

The initial mixing stage from the microwave frequency to the rf results in a 
substantial heterodyne factor, 77.5 for the example chosen. The output of the 
first conversion stage lies within the range of low-noise commercial frequency 
synthesizers, which makes it possible to obtain a fixed, low beat frequency 
over a wide range of input frequencies. The initial mixing stage also reduces 
the frequency synthesizer’s contribution to the measurement-system noise. 
Figure 12-25 shows the typical phase excursions of a high-quality commercial 
synthesizer operated near 5 MHz. 

Under some circumstances a frequency divider may be used to provide 
the signal for the second mixing stage. as shown in Fig. 12-26. This technique 
has the disadvantage of requiring a custom divider but results in much 
lower measurement noise than the direct use of a synthesizer with a single 
heterodyne stage. 
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FIG. 12-25 Typical phase excursions of a commercial frequency synthesizer. 
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FIG 12.26 Use ofa simple divider as a substitute for a commercial frequency synthesizer in 
a heterodyne measurement system. Better noise performance can result from the initial mixing 
stage. 


12.3.3.2 THE DUAL-MIXER TIME-DIFFERENCE 
TECHNIQUE 


There is no best answer to the question of how to make frequency-stability 
measurements. However, by combining versatility with low-noise perform- 
ance, the dual-mixer time-difference technique (Cutler and Searle, 1966; Allan 
and Daams, 1975) shown in Fig. 12-27 comes close to the ideal. The original 
motivation for this method was to use a transfer oscillator and two mixers in 
parallel to permit short-term frequency-stability measurements between 
oscillators that have an inconveniently small frequency difference. The 
transfer oscillator is most easily realized with a frequency synthesizer locked 
to one of the oscillators, designated oscillator 1 in Fig. 12-27. By convention 
the frequency of the synthesizer is set low compared to the oscillator under 
test, so we write the frequency of the synthesizer as 

y, = vi(l — 1/R). (12-83) 

The constant R is equal to the heterodyne factor, which can be seen by 
calculating the beat frequency between oscillator | and the synthesizer: 

Ye: = VY, — ¥, = /R. (12-84) 


OSCILLATOR 1 


CROSSING 
DETECTOR 


OSCILLATOR 2 


FIG. 12-27 A dual-mixer measurement system. The scalars measure the number of whole 
cycles of elapsed phase, while the time-interval counter measures the fractional cycle 
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The combination of oscillator, frequency synthesizer, and mixer functions as 
a divider and scaler 1 functions as the system clock, recording elapsed time in 
units of cycles of oscillator 1. 

The signals from oscillators 1 and 2 are represented according to Eq. 
(12-52) with $19 = 39 = 0, and the signal from the synthesizer is written 


V(t) = Vig cos(2xv,or + $1). (12-85) 


The phase of the synthesizer retards nearly linearly in time compared to the 
phase of oscillators 1 and 2. At time ty the synthesizer reaches phase 
quadrature with oscillator 1 and the beat signal crosses zero (in the positive 
direction), producing a pulse from the zero-crossing detector and starting 
the time-interval counter. At a later time ty the continued sweep of the 
synthesizer has brought it into quadrature with oscillator 2, and a pulse is 
produced that stops the time-interval counter. The phase difference between 
the oscillators can be written in terms of the three counter readings: 


halteg) — Piltay) = AN — Mix — 2nL pat: wit. P, (12-86) 


where N is the reading of scaler 2, M the reading of scaler 1, P the reading of 
the time-interval counter, and t, the period of its time base (Stein er al., 1983). 
Comparison with Eq. (12-45) for direct time-interval measurements reveals 
that the role of the scalers is to accumulate the coarse phase difference 
between the oscillators, while the time-interval counter provides fine-grain 
resolution of the fractional cycle. This process is illustrated in Fig. 12-28. The 
advantage of the technique over direct time-interval measurements is that the 
noise performance is improved by the large heterodyne factor, allowing time 
resolution of 0.1 psec to be obtained. The synthesizer degrades the noise 
performance very little since it contributes to the noise only over the interval 
1, P. 


x(t) 


fi 
' 
1 
10 


TIME 

FIG. 12-28 Total elapsed phase measured by the dual-mixer system of Fig 12-27 (solid 
line}, This phase measurement consists of two components. the number of full cycles that have 
elapsed is the step function plotted as a dashed line. the fractional cycie is the sa-tooth function 
plotied as open circles. 
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The average beat frequency ¥2(t,: ty) cannot be known exactly, but it may 
be estimated with sufficient precision if it changes slowly compared to the 
interval between measurements. If the primed and unprimed variables 
represent two independent measurements, then 


Fpalty:ty) & (N' — NY/[R(M’ — M)/vig + t(P' — Pi). (12-87) 


12.3.3.3 FREQUENCY MULTIPLICATION 


A frequency multiplier produces n full cycles of the output signal for each 
cycle of the input signal, where n is an integer determined by the design of the 
device. Such a device is also a phase multiplier, that is, the total phase 
accumulation of the output signal is n times as great as the phase accumu- 
lation of the input signal: 


Dye = Weyl + Poult) = A(nvjglt + Ndiq(t). (12-88) 


It follows that the spectral density of the output signal is enhanced by a factor 
of n? compared to the input signal, 


Sool) = 756,11 


making it easier to perform the necessary noise measurements. Similarly, 11 is 
also easier to make Allan-variance measurements. If the oscillator under test 
and the reference are both multiplied by the same factor, the beat frequency 
will be n times larger than with no multiplication but the heterodyne factor 
will be the same. The zero crossings that must be detected by the counter 
have n times higher slope and more easily overcome the voltage noise in the 
counter trigger circuits. The ability to measure frequency stability is only 
enhanced if the multipliers have extremely low phase noise themselves. This is 
the case for many modern multipliers that are triggered by the zero crossings 
of the input signal. As a result, the use of multipliers can reduce the 
performance requirements on the phase detector and the following low-noise 
amplifiers. 


12.4 CONCLUSION 


The IEEE recommendations have achieved the goal of introducing 
substantial uniformity in the specification of oscillator performance. The 
Allan variance and the one-sided power spectral density of phase have proved 
sufficient to evaluate oscillators for all common applications. In a few cases 
more specialized measures are helpful in relating performance to the specific 
application. For example, the rms time-prediction error is helpful in judging a 
clock’s ability to keep time over long intervals (Allan and Hellwig, 1978). 


TN-101 


232 SAMUEL R. STEIN 


However, the specialized performance measures are generally calculable in 
terms of the IEEE recommended measures. 

Significant progress has been made during the last 15 years in measure- 
ment techniques and data processing. These advances have obscured the 
dividing line between the frequency domain and the time domain. Today the 
spectral density and the variance are most often computed from the identical 
input data set, the equally spaced time series of the phase deviations. The 
choice of a specific measurement setup can be made mostly on a cost versus 
performance basis. Perhaps the biggest advance in commercially available 
equipment is the introduction of heterodyne measurement techniques for 
time-domain (counter-based) measurements. As a result, the noise perform- 
ance of these systems has improved dramatically. 

One recommendation that should be made is to perform measurements as 
high up in the measurement hierarchy as possible. Direct measurement of the 
phase deviation is most desirable. This approach places the largest share of 
the burden on the measurement equipment, minimizes long-term errors, and 
maximizes data processing flexibility. 
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Time and Frequency (Time-Domain) Characterization, 
Estimation, and Prediction of Precision 
Clocks and Oscillators 


Invited Paper 


DAVID W. ALLAN 


Abstract—A tutorial review of some time-domain methods of char- 
ing the performance of precision clocks and oscillators is pre- 
Characterizing both the systematic and random deviations is 
considered. The Allan variance and the modified Allan variance are 
defined, and methods of utilizing them are presented along with ranges 
and areas of applicability. The standard deviation is contrasted and 
shown not to be. in general, 2 good measure for precision clocks and 
oscillators. Once a proper characterization model has been developed, 
then optimum estimation and prediction techniques can be emplo} 
‘Some important cases are illustrated. As precision clocks and oscilla- 
tors become increasingly important in society . communication of their 
characteristicy and specifications among the vendors. manufacturers, 
metralogists of this equipment be- 


comes increayingls important. 


INTRODUCTION 


‘ “wre THEN.” asked St. Augustine. *‘is time? 

If no one asks me. I know what it is, If 1 wish 
to explain it to him who asks me. | do not know." Though 
Einstein and others have taught us a lot since St. Augus- 
tine. there are still many unanswered questions. In panic- 
ular. can time be measured? It seems that it cannot. what 
is measured is the time difference between two clocks. 
The time of an event with reference to a panicular clock 
can be measured. If time cannot be measured. is it phys- 
ical, an abstraction, or is it an artifact? 

We conceptualize some of the laws of physics with time 
as the independent variable. We attempt to approximate 
our conceptualized ideal time by inverting these laws so 
that time is the dependent variable. The fact is that time 
as we now generate it is dependent upon defined origins, 
a defined resonance in the cesium atom. interrogating 
electronics. induced biases. timescale algorithms. and 
random perturbations from the ideal. Hence, at a signifi- 
cant level. time—as man generates it by the best means 
available to him—is an artifact. Corollaries to this are that 
every clock disagrees with every other clock essentially 
always, and no clock keeps ideal or ‘‘true’* time in an 
abstract sense except as we may choose to define it. Fre- 
quency or mie interval. on the other hand, is fundamental 
to nature, hence the definition of the second can approach 
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the ideal—down to some accuracy limit. Noise in nature 
is also fundamental. Characterizing the random variations 
of a clock opens the door to optimum estimation of en- 
vironmental influences and to the design of optimum com- 
bining algorithms for the generation of uniform time and 
for providing a stable and accurate frequency reference. 

Let us define V(r) as the sine-wave voltage output of a 
Precision oscillator: 


V(t) = Vy sin (1) (1) 


where $(r) is the abstract but actual total time-dependent 
accumulated phase starting from some arbitrary origin O(¢ 
= 0) = 0, We assume that the amplitude fluctuations are 
negligible around Vy. Cases exist in which this assump- 
tion is not valid, but we will not treat those in the context 
of this paper. This lack of treatment has no impact on the 
development or the conclusions in this paper. Since infi- 
nite bandwidth measurement equipment is not available 
10 us, we cannot measure instantaneous frequency; there- 
fore v(1) = (1/2m) db/dr is not measurable. We can 
rewrite this equation with vp being a constant nominal fre- 
quency and place all of the deviations in a residual phase 
elt) 


V(r) = Vy sin (2avot + O(1)) (2) * 


We then define a quantity (1) = (v(1) — »9)/¥. which 
is dimensionless and which is the fractional or normalized 
frequency deviation of »(r) from its nominal value, In- 
tegrating y(1) yields the time deviation x(r), which has 
the dimensions of time 


x(t) = \iry ae (3) 


From this, the time deviation of a clock can be written as 
a function of the phase deviation: 


o(t) 
x(t) ==—. (4) 
2a¥9 
Systematic MODELS FoR CLOCKS AND OSCILLATORS 


The next question one may ask is why does a clock 
deviate from the ideal? We conceptualize two categories 
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Fig. 1. Frequency y(t) and time (1) deviations due to frequency offset 
and to frequency dnft in clock. (a) Fractional frequency error versus 
time, «b) Time error versus time 


of reasons. the first being systematics such as frequency 
drift (D), frequency offset ( vo), and time offset (.t9). In 
addition, there are systematic deviations that are often en- 
vironmentally induced. The second category is the ran- 
dom deviations €(7). which are usually not thought to be 
deterministic. In general. we may write 


a(t) = x9 + yor + 1/2 Dr? + e(t) (5) 


Though generally useful, the model in (5) does not apply 
in all cases: e.g.. some oscillators have significant fre- 
quency-modulation sidebands, and in others the fre- 
quency dritt D is not constant. In some clocks and oscil- 
lators, e.g.. cesium-beam standards. setting D = 0 is 
usually a better model. 

Note that the quadratic D term occurs because x(1) is 
the integral of y(1), the fractional frequency. and is often 
the predominant cause of time deviation, In Fig. | we 
have simulated two systematic-error cases: a clock with 
frequency offset. and a clock with negative frequency 
drift. Figs. 2-6 summarize some of the important system- 
atic influences on precision clocks and oscillators. In ad- 
dition to Figs. 1-6, important systematic deviations may 
include modulation sidebands. e.g., 60 Hz, 120 Hz. daily. 
and annual dependences, which can be manifestations of 
environmental effects such as deviations induced by vi- 
brations, shock, radiation, humidity, and temperature. 

‘W See Appendix Note # 12 
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Fig. 2. Nominal values for temperature coeMficient for frequency stan- 
dards: QU = quanz crystal, RB = rubidium gas cell, H = active hy- 
drogen maser, H(pas) = passive hydrogen maser, and CS = cesium 
beam 
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Fig. 3. Nominal values for magnetic field sensitivity for frequency stan- 
dards QU = quartz crystal. RB = rubidium gas cell. H = active hy- 
drogen maser, H(pas) = passive hydrogen maser, and CS = cesium 
beam 
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Fig 4. Nominal capability of frequency standard to reproduce same fre- 
quency after penod of time for standards: QU = quanz crystal. RB = 
rubidium gas cell. H = active hydrogen maser, Hi pas) = passive hy- 
drogen maser. and CS = cesium beam 
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Fig 5. Nominal capability for frequency standard to produce frequency 
determined by fundamental constants of nature for standards: QU = 
quanz crystal, RB = rubidium gas cell, H = active hydrogen maser. 
H( pas) = passive hydrogen maser. and CS = cesium beam. 
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TABLE! 


APPLICABLE OSCILLATORS AND RANGE OF APPLICABI 


eee 


Typical Noise Types 


e Name cs H-Active H-Passive Qu Rb 

2 white-noise PM 5100s sims 

1 flicker-noise PM sis 

O white-noise FM 10s 100s sr2i0's ats zs 
1 ficker-noise FM = days 210s zdays eis 210° 
2 random-walk FM © 2weeks 2 weeks zweeks = 2h 2 days 
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Fig. 6. Nominal values (ignonng sign) for frequency diift for frequency 
standards QU = quanz crystal, RB = rubidium gas cell, H = active 
hydrogen maser, H( pas) = passive hydrogen maser, and CS = cesium 
beam. 
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Fig. 7. Simulated random processes commonly occurring in output signal 
Of atomic clocks. Power law spectra Sif) are proportional to w to some 
exponent, where f is Founer frequency ((w = 2xf) and S,(f) = 
wWS4f)) 


Rasoom Mopets For CLocks AND OSCILLATORS 


The random-frequency deviations of precision clocks 
and oscillators can often be characterized by power-law 
spectra S,{ f) ~ f, where fis the Fourier frequency and 
@ typically takes on integer values, i.e., ~2, —1,0, 1,2 
[1]-[4}]. Fig. 7 shows noise samples corresponding to 
these different power law spectra, and Table I shows the 
nominal range of applicability of these power-law models. 


Time-Domain SiGNat CHARACTERIZATION 


Given a discrete set of time deviations x, taken in se- 
quence for the measurable time difference between a pair 
of clocks or between a clock and some primary reference, 
and given that the nominal spacing between adjacent time 
difference measurements is 7 (see Fig. 8 for an example). 


See Appendix Note #13 


then the average fractional frequency for the ith measure- 
ment interval is 


ed 


(6) 


where —79 over y, denotes the average over an interval T9 

We can thus construct a set of discrete frequency values 
from such a time-difference data set. If the standard de- 
viation is calculated for this set of values, one can show 
that for some kinds of power-law spectra encountered in 
precision oscillators the standard deviation is divergent 
(1), (2). [5]. ie, it does not converge to a well-defined 
value and is a function of data length. Hence the standard 
deviation is seldom useful and can be misleading in char- 
acterizing clocks. An IEEE subcommittee has recom- 
mended S,( f) in the frequency domain and a measure 
o2(r) in the time domain [1]. 5,(f) is the one-sided 
spectral density of y as a function of Founer frequency f. 
The latter is often called the Allan variance or two-sample 
vanance. The convergence of g,(r) has been verified [1]- 
(4] for the power law spectra of interest in precision clocks 
and oscillators. The measure o3( 7) is defined as [1] 


oX(r) = 4 ((a5)') a) 


where A¥v"' is the difference between adjacent fractional 
frequency measurements, each sampled over an interval 
r, and the brackets ¢ ) indicate an infinite time average 
of expectation value. A pictorial description is shown in 
Fig. 9 fora finite data set. A data set of the order of 100 
points is more than adequate for convergence of a,(7), 
though of course the confidence of the estimate will typ- 
ically improve as the data length increases [6], 

Given a discrete set of stored evenly spaced data, the 
value of + can be varied in the software [7]. If 7) is the 
minimum data spacing for the original stored data set y®, 
then one can change the sampling time to r = nq by av- 


eraging n adjacent values of y, ™ to obtain a new fractional * * 


frequency estimate }{, with sample time 7 as input to (7). 
Note this is different from averaging adjacent values of x. 
Hence in a very convenient way one can calculate 6,(7) 
as a function of r, which will be shown to be very useful. 
For a finite data set of M values of y, (7) for general r 
becomes (see Fig. 8 for an example computation of o,(7 
‘Se See Appendix Note # 14 
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Fig. 8. Simulated time deviation plot x(1) with indicated sample time r over which each adjacent fractional frequency ¥, is 
measured. Equations are for standard deviation and for estimate of o,(r) for finite data set of M frequency measurements 
Often standard deviation diverges as data length increases when measuring long-term frequency stability of precision oscil- 


lators, whereas 0, (1) converges 
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Fig. 9. Pictorial of computation of Allan variance. Simulated time varia- 
ions plotted are random walk. At set sample time r, Ay = (x) — 2e: — 
x,)/1 is computed. With time of measurement of x, 7 ahead of x; and 
that of x 7 ahead of 2,, all possible values of Av are computed. Each 
Ay is squared and average squared value determined, (35); taking 1/2 
of this yields two-sample or Allan variance for that value of 7. Value of 
7-can then be changed either in hardware or software to determine Allan 
variance for another value of 


= 1). ie.,n = 1) 
1 M-laet = Je 
y(t) = (Mien — HY (8) 


2(M — 2n +1) 2 


where Yi., and yj are still adjacent fractional frequen- 
cies (i¢., no dead time exists between the measure- 
ments), each averaged over 7 = nto, and 
hea-t 
aS x w= 


Xeon — Xe 


(9)* 
Alternately, one may write (see Fig. 9 for an example) 


oi(7) = 


IF(M —2n +1) 
M-lnel 
x (isa — en +5) 


‘© See Appendix Note # 15 


(10) 


where x, is taken from the set of M + 1 = N discrete time 
deviation measurements between a pair of clocks or os- 
cillators, i = 110M + 1: 
t 

Ker =m DIM + a. (a) 
Equation (8) is obtained from a first difference on fre- 
quency, and (10) from the second difference on the time; 
they are mathematically identical, yielding the option of 
using frequency or time (phase) data. 

For power- law spectra the following proportionality ap- 
plies: 0; 2(7) — 7%, where y is typically constant for a 
particular value of a. A simple and elegant relationship 
exists between the spectral density exponent & (in the re- 
lationship S,(f) ~ f°) and p, ie. w= -a — 1(-3 
< as l)andy = —2(a & 1) [8]. For example, for 
a significant range of 7 values. o,(7) ~ 1” ? is propor- 
tional to r~‘''?! for cesium. rubidium, and passive hy- 
drogen maser frequency standards. Therefore p has the 
value of —1, and hence a has the value of 0 (white-noise 
frequency modulation). This is the classical noise exhib- 
ited by an imponant set of atomic clocks for r’s beyond 
a few seconds. In this case. 0, (79) is equal to the standard 
deviation. Fortunately, for most cases with precision 
clocks and oscillators where 7 = 1 s. the simple relation- 
ship ¢ = —a@ — 1 is applicable. It is convenient to plot 
log 0,(1) versus log 7 to estimate the value of » and to 
letn = 2',1=0. 1,2, +++ (7 = nt). 

An ambiguity exists at » = —2, one cannot conve- 
niently tell whether the noise process is flicker-noise phase 
modulation (PM), « = +1. or white-noise PM. a = +2. 
This ambiguity can be resolved by realizing that for these 
cases o,(7) depends on the measurement bandwidth [2]. 
[3]. One can construct a variable software bandwidth f, 
by realizing the following [9]. [10]. In any measurement 
system a hardware bandwidth f, exists through which we 
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TABLE II" 
Classical Classical 
Typical Noise Types, Standard Standard 
e Name a(n) = Deviation of x Deviation of y 


2 white-noise PM 
1 fiicker-noise PM =r alr) 
© white-noise FM 
1 flicker-noise FM undefined 
2 random-walk FM undefined 


+ 0,(7)/V3 (constant) 
vin M7in 3 
To * 8, (to) VM + 11/6 


o,(7) V20N + D730, 
sea VEIN + T73N 


#,(% 
iS Ya N/AQUN = 1) in 2) 
7) VN/2 


“Note 7 is a general averaging time and 79 is the initial averaging time (7 = mr, where n is an integer). 
Also note that the last four entries in the fourth column and the last two entries in the fifth column go to 
infinity as Mf or N go to infinity. Mf 1s the initial number of frequency difference measurements and N the 
number of phase or time difference measurements N = M + I Ifthe spectral density is given by S,( /) 


= hf? then 
1) 


wo (2) se 


a= (3) (1.038 + 3 bog, (24/7) hy) 


~-(Z)s 


a.) = 2 hog (2)h., 


"Note this equality assumes use of modified o3(r) = 3: (1) 


Measure the phase difference or the time difference be- 
tween a pair of oscillators or clocks and we define 7, = 
1/f,. In other words, 1, is the sample time period through 
which the time or phase date are observed or averaged. 
Averaging n time or phase readings increases the sample 
time window to nz, = 7,. Let r, = 1/f,; then f, = f,/n, 
the software bandwidth is narrowed to f,. In other 
words, f, = f,/n decreases as we average more values; 
i.e., increase n (+ = 7g). One can therefore construct a 
second difference composed of time deviations so-aver- 
aged and then define a modified o7(7) = 67(7) that will 
remove the ambiguity through bandwidth variation: 


1 
———— 
2r'n=(N — 3n + 1) 


Br) = 


ya - 
(12) 


where N = M + 1, the number of time-deviation mea- 
surements available from the data set. Now if 33(r) ~ 
ry then yp’ = —a — 1 (1 = @ = 3) (10), [11]. Thus 
G,( 7) is typically employed as a subroutine to remove the 
ambiguity if o,(r) ~ 7~'. This is because the p' = -a@ 
— 1 relationship is valid as an asymptotic limit for large 
nand a < 1 and is not valid in general; however, there 
is evidence that ai 7) may be a better measure [12]. Spe- 
cifically, fora = 2 and 1, w'/2 equals —3/2 and —1, 
respectively, providing a clean differentiation between 
white-noise PM and flicker-noise PM. 

If three or more independent oscillators or clocks are 
available along with time (phase) or frequency measure- 
‘© See Appendix Note # 16 


ments between them, then it is possible to estimate a var- 
iance for each oscillator or clock, Often there is a refer- 
ence to which the rest are periodically measured at a 
sampling rate 1/t9. If at each measurement the time or 
frequency differences between the clocks are measured at 
nominally the same time, then the time difference or fre- 
quency difference can usually be estimated or calculated 
between every possible pair in the set of oscillators or 
clocks. Given a series of measurements, variances 53 can 
be calculated on the time or frequency data between all 
pairs. It has been shown [13] that the individual clock 
variances can be estimated using the following equations: 


—(E5-2) 


os 


where 


Tm Lie (13) 
m is the number of clocks available in the set, sand sh = 
0. If the variance measures used are o}(7) or 0; 2(7), then 
(13) can be used to estimate the individual variances asa 
function of r. 

Table II illustrates why one should not use the standard 
deviation to characterize clocks. For the different kinds of 
noise processes we list the standard deviation of the time 
deviations and of the fractional frequency deviations as a 
function of o,(7). The divergent nature of the standard 
deviation is apparent. Even for classical white-noise FM 
the standard deviation of the time diverges as the square 
root of the data length, i.¢., the number of samples N [2]. 
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TABLE Ill 
Optimum 
‘Typical Noise Types Prediction Time Error 
a Name a(s,) ems* Asymptotic Form 
2 white-noise PM ARE at 
fy flicker-noise PM 1,) vin 1,72 In te Te t, 
C) se FM re} qn 
-1 flicker-noise FM 1,)/Vin2 


2 random-walk FM 
“r, is the prediction interval 


TIME AND FREQUENCY ESTIMATION AND PREDICTION 

Using o,(7), G,(7), S,(f), or Sy(f), one can char- 
acterize typical power law processes. Once characterized, 
this opens the opportunity for determining optimum esti- 
mates of values by employing the statistical theorem that 
the optimum estimate of a white-noise process is the sim- 
ple mean. 

For example, consider the very common and very im- 
portant case of white-noise FM typically found on the sig- 
nals from cesium standards, rubidium standards, and pas- 
sive hydrogen masers. The optimum estimate of the 
frequency is the simple mean frequency, which is equiv- 
alent to (xy — x,)/Mro. Itis still all too common within 
our discipline to see our colleagues erroneously determin- 
ing the frequency for these kinds of oscillators by calcu- 
lating the slope from a linear least-squares fit to the time 
deviations and quoting the standard deviation around that 
fit as a measure of the clock performance. There are three 
problems in proceeding this way. First, the frequency es- 
timate is not optimum in a mean-square-error sense. It is 
equivalent to throwing away about 20 percent of the data 
and thereby increasing the cost in the case of a calibra- 
tion. Second, the standard deviation diverges as the square 
root of the data length. Third, the standard deviation is 
Significantly dependent on the filter form, e.g-, linear least 
squares, as well as the clock deviations. On the other 
hand, such a filter is sometimes useful for assessing out- 
liers. The optimum ‘‘end-point’* method outlined earlier 
has the risk that if either of the points is abnormal, (i.e., 
the model fails), the result will of course be adversely 
effected, Therefore such a filter is useful to assess whether 
there are outliers—paying special attention to the end 
points. Also, if the measurement noise exceeds the com- 
bined noise in the clocks, then the end points will be ad- 
versely affected. The key message is that the end-point 
method for estimating frequency is only optimum if the 
noise is pure white FM, which is easy to determine from 
a log o,(1) versus log r plot. 

There are other useful, and maybe not so obvious, op- 
timum estimators appropriate for time-difference data sets. 


1) Given white-noise PM, the best time estimate is the 
simple mean of the time deviations; the frequency 
estimate then is the slope from a linear least-squares 
fit to the time deviations, and the frequency drift D 
is determined from a quadratic least-squares fit to 
the time deviations per (1). 


2) Given white-noise FM, the optimum estimate of the 
time is the last value; the optimum-frequency esti- 
mate is outlined in the previous paragraph, and the 
optimum-frequency-drift estimate is derived from a 
linear least-squares fit to the frequency. 

3) Given random-walk FM, the current optimum time 
estimate is the last value plus the last slope (clock 
rate) times the time since the last value; the opti- 
mum-frequency estimate is obtained from the last 
slope of the time deviations; and the optimum-fre- 
quency-drift estimate is calculated from the mean 
second difference of the time deviations. Caution 
needs to be exercised here, for typically there will 
be higher frequency component noise in a real data 
stream, such as white-noise FM, along with ran- 
dom-walk FM, and this can significantly contami- 
nate the drift estimate from a mean second differ- 
ence. If random-walk FM is the predominant long- 
term power-law process, which is often the case, 
then the effect of high-frequency noise can be re- 
duced by calculating the second difference from the 
first, middle, and end-time deviation points of the 
data set. 


The flicker-noise cases are significantly more compli- 
cated, though filters can be designed to approximate op- 
timum estimation [14]-[16]. As the data length increases 
without limit, time is not defined for flicker-noise PM, 
and frequency is not defined for flicker-noise FM. This 
has some philosophical implications for the definitions of 
time and frequency. unless some low-frequency cutoff 
limits exist. If significant frequency drift exists in the data, 
it should be optimally subtracted from the data or it will 
bias the long-term values of o,(r): 


(14) 


o,(7) = De 


Once the power-law spectra are deduced for a pair of 
oscillators or clocks, then one can also develop an opti- 
mum predictor. Table III gives both the optimum predic- 
tion uncertainty values for the various relevant pure 
power-law spectra as well as their asymptotic forms. Spe- 
cial forecasting techniques must be used for optimal pre- 
diction when combinations of these processes are present 
[17]. To illustrate how these concepts relate to real de- 
vices, Fig. 10 shows a o,(7) diagram for some interesting 
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Fig. 10, Square root of Allan variance for variety of state-of-the-ant pre- 
cision oscillators including NBS-6, NBS primary frequency standard. 


AMS TIME DEVIATION 


Fig. 11. From frequency stability characterization shown in Fig. 10, op- 
timum prediction algorithms to minimize time error can be obtained 
Based on optimum prediction procedures rms time prediction error for 
prediction interval 7, can de calculated for each oscillator shown in Fig 
10 and corresponding values are plotted in Fig. 11 


State-of-the-art oscillators, and Fig. 11 shows the rms time 
Prediction errors for the same set of oscillators. 


ConcLusion 


In conclusion, it is clear that classical statistics do not 
allow characterization of common kinds of random signal 
variations found in precision oscillators. The two-sample 
Allan variance provides a valuable and convergent mea- 
sure of the power-law spectral-density models useful in 
characterizing random deviations for most oscillators and 
clocks. Once characterized, we can calculate optimum 
time and frequency estimates as well as predicted values 
Characterizing the random variations also provides near- 
optimum estimation of systematic effects, which often 
cause the predominant time and frequency deviations. For 
example, if we wanted to optimally determine the static 
temperature dependence with the temperature set at two 
different values, we would stabilize the oscillator at one 
temperature and measure the frequency against a refer- 
ence for a time 7,,, corresponding to the 7 for the nominal 
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minimum o,(7) value. We would then change the tem- 
perature to the other value and repeat the measurement 
with the same criteria and note the Ay™ between the two 
optimally determined frequency values, If these two steps 
are repeated several times, an arbitrarily good precision 
for the temperature coefficient is achieved if it is li 
The uncertainty is approximately given by o,(1,)/VP, 
where P is the number of Ay™ values obtained from 
switching back and forth. Knowing the characteristics of 
both the random and the systematic deviations of preci- 
sion clocks and oscillators clearly is useful to the de- 
signer, the manufacturer, the planner, and the user as well 
as the vendor of these devices. 

The aforementioned procedures usually work well if the 
clocks or oscillators are in a reasonable environment. If 
the environment is adverse, other procedures and analysis 
methods may have to be employed. As a general rule it is 
often useful to analyze the data in the frequency domain 
as well as the time domain. The frequency domain is es- 
pecially useful if there are bright lines, i.¢., sidebands to 
the carrier frequency. The effect of a modulation sideband 
Sm On 9,(7) can be calculated, and is given by [18] 


(15) 


where x,, is equal to the peak-to-peak or twice the ampli- 
tude of the time-deviation modulation 

If one is trying to estimate the power-law spectral be- 
havior between a pair of oscillators or clocks using 9,(r), 
it is apparent from (15) that if significant modulation 
sidebands are present on the signal, these can seriously 
contaminate that estimate. However, if a o,(r) plot dis- 
plays a character as given by (15), then the amplitude and 
frequency of that modulation sideband can be estimated 
from this time-domain analysis technique. In practice, this 
approach is often used, but these modulation sidebands 
can be more efficiently estimated in the frequency do- 
main. If the measurement sampling rate 1/79 is set equal 
to f,,, then the modulation sideband is aliased away and 
has no effect on o,(7). 

The best rule in all analysis is to use common sense. 
Very often the most revealing information may be in a 
plot of the raw time (phase) difference or frequency-dif- 
ference residuals after some trend has been removed. Such 
a plot is usually the first thing to look at when character- 
izing clocks and oscillators. Caution here is also impor- 
tant as a pure random walk on the time residuals (white 
FM) may be visually interpreted as having frequency 
steps. This is especially true for flicker FM as often seen 
in quartz-crystal oscillators. Following the time-residual 
plot with a o,(7) analysis often answers the question as 
to whether or not such steps are statistically significant. 


a,(r) = * sin? (xf,7) 
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Summary 


This paper describes recent progress in extending 
high accuracy measurements of phase noise in 
oscillators and other devices for carrier frequencies 
from the rf to the eillimeter region and Fourier 
frequencies up to 108 of the carrier (or s saxisum of 
about 1 GHz). A brief survey of tradicional 
precision techniques for measuring phase noise is 
included as a basis for comparing their relative 
performance and limitations. The single oscillator 
techniques, although conceptually simple. require « 
set of 5 to 10 references to adequately measure the 
phase noise from 1 Hz to ! GHz from the carrier, The 
two oscillator technique yields excellent noise 
floors if, for oscillator aeasurements, one has = 
comparable or better illator for the reference 
and, for other devices, either pairs of devices or a 
reference oscillator with comparable or better noise. 
We have developed several new calibration techniques 
which, vhen combined with previous two oscillator 
techniques, permits one to calibrate all factors 
affecting the measurements of phase noise of 
oscillator pairs to an accuracy which typically 
exceeds 1 dB and in favorable cases can approach 0.4 
4B. In order to illustrate this expanded tvo 
oscillator approach, measurements at 5 MHz and 10 GHz 
are described in detail. At 5 MHz we achieved 
accuracies of about 20.6 dB for phase noi. 
measurements from 20 Hz to 100 kHz from the carrier 
At 10 GHz we achieved an accuracy of 20.6 6B for 
phase noise measurements a few kHz from the carrier 
degrading to about t1.5 dB, 1 GHz from the carrier 


L_intreduction 


‘This paper describes recent progress at the National 
Bureau of Standards (NBS) in extending high accuracy 
Measurements of phase noise in oscillators, 
amplifiers. frequency synthesizers, and passive 
components at carrier frequencies from the rf to the 
millimeter region and Fourier frequencies up to 108 
of the carrier (or a maximum of about 1 GHz). An 
examination of existing techniques for precision 
phase noise measurements of oscillators(1-11] shoved 
nt approaches which don’t require a second 
* oscillator have good resolution or noise 
floor for Fourier frequencies extending over only 1 
or 2 decades.(7-10) Consequently, these approaches 
require a set of 5 to 10 references. either delay 
lines or high Q factor cavities, in order to 
adequately measure the phase noise from 1 Hz to 1 GHz 
from the carrier. Using the cavity approach would 
require « entire set of reference cavities for each 
carrier frequency measured, Similar considerations 
also apply to phase noise measuresents of the other 
devices unless one can measure pairs of devices. 


The Limitations of the single oscillator techniques 
led us to adopt a two oscillator method for all 

measurements. This approach yields good resolution 
or noise floor from essentially de to the bandwidth 
of the mixer if, for oscillator measurements 
4 comparable or better oscillator for the r 
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and, for other devices, either pairs of devices or a 
reference oscillator with comparable or better noise 


The major limitations in the accuracy of the tvo 
oscillator method (which also apply to che single 
oscillator methods) are the calibration of: the mixer 
phase-to-voltage conversion factor, the amplifier 
gain versus Fourier frequency, and the accuracy of 
the spectrum analyzer. We have developed several new 
calibration techniques which, when combined with 
previous techniques, allow us co address each of 

these Limitations. The nec result {s che development 
of a complete measurement concept chat permits one to 
calibrate all factors affecting the measurements of 
phase noise of oscillator pairs to an accuracy which 
typically exceeds 1 dB and in favorable cases can 
approach 0.4 dB, For other types of devices che 
Limitations are similar if the noise of the reference 
oscillator can be neglected. The ultimate accuracy 
that can be easily achieved with this approach is now 
limited by the accuracy of the attenuators in 
available spectrum analyzers 


Measurements ac 5 MHz and 10 GHz are described in 
detail, in order to illustrate this expanded two 
oscillator approach. Specifically we seasure che 
mixer phase-to-voltage conversion factor multiplied 
by amplifier gain on all channels versus Fourier 
frequency using @ new ultra-wideband phase modulacor 
We then measure the absolure mixer conversion factor 
multiplied by the amplifier gain at one Fourier 
frequency, the effect of the phase-lock loop on the 
measured noise vol 4 spectral density function 
of the spectrum analyzers. These measurements are 
used to normalize the relative gains of che noise 
Reasurements on the various channels. At $ MHz ve 
achieved accuracies of about $0.6 4B for phase noi 
Seasurements frou 20 Hz to 100 kHz from the carrier 
At 10 GHz we achieved an accuracy of £0.6 4B for 
phase noise measurements a few kHz to 500 MHz from 
the carrier, The accuracy degrades to about £1.5 dB, 
1 GHz from the carrier 


IL_Hodel of a Noisy Signal 


The output of an oscillator can be expressed as 
Wit) = [V, + e(t)] sin(2ev,e + o(t)), a) 


where V, is the nominal peak output voitage, and v, 
is the nominal frequency of the oscillator. The time 
variations of amplitude have been incorporated into 
e(t) and the time variations of the instantaneous 
frequency, »(t). have been incorporated into ¢(t) 
The instantaneous frequency is 


alee] 
— 


v(t) = (2) 


dedt 


The fractional frequency deviation is defined as 


v(t) =v, dle(er] 
y(t) «= ———= Q) 
% devgdt 
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Power spectral analysis of the output signal V(t) 
combines the power in the carrier v, with che pover 
in ¢(t) and ¢(t) and therefore is not a good method 
to characterize ¢(t) or ¢(t). 


Since in many precision sources understanding the 
variations in ¢(t) or y(t) is of primary importance, 
we will confine the following discussion to 
frequency-domain measures of y(t), neglecting ¢(t) 
except in cases vhere it sets limits on the 
measurement of y(t). The amplitude fluctuations, 
e(t), can be reduced using limiters whereas ¢(t) can 
be reduced in some cases by the use of narrow band 
filters. 


Specctral (Fourier) analysis of y(t) is often 

in terms of S,(f), the spectral density of 
phase fluctuations in units of radians squared per Hz 
bandwidth at Fourter frequency f from the carrier v,. 
Alcernately $,(f), the spectral density of fractional 
frequency fluctuations in a 1 Hz bandwidth at 
frequency f from the carrier v, can be used 
are related as 


2 


Sy(f) = = Sy (E) tad? fiz O<f<e | (4) 
£ 
$,(£) can be intuitively understood as, 
ag? (£) 
S4(£) = —— (3) 


where 46(f) is the rms phase deviation measured at 
Fourier frequency £ from the carrier in a bandwidth 
BY, It should be noted that these are sing’ 
ctral density oe 4 containing the ph: 
frequency fluctuations from both sides of the 
carrier, The mean squared phase aodulation in a 
measurement bandwidth, BW, is given by 


+Bu/2 


agit) = S,(£) df . (6) 


-Bw/2 


Ocher measures somecii 
aBC/Hz, and S,,(£). 


encountered are £(f), 
These are relaced by (1-3) 


Sy, (£) = v3S,(£) He? /Hz 


S4(£) = £(vp-£) + Blvyef) = 28(E) m 


ABC/Hz = 10 log ¥(£) 


2(£) and dBC/Hz are single sideband measures of ph: 
noise. 
ABC as per the most recent recommendation of the 
Standards Coordinating Committee for Time and 
Frequency of the IEEE [3], With these revised 
definitions £(f) and 4BC/Hz are now defined for 
arbitrarily large phase modulation, vhereas 
previously they were restricted to small angle 
modulation. In some situations, especially where £ 
becomes a sizeable fraction of vy, the phase noise 
spectrum is asymmetric about the carrier. In these 
cases one should specify whether the upper sideband 
noise £(vj+f) or the lower sideband noise #(v)-f) is 
being referenced, These distinctions are becoming 


3 See Append Nowe Fo 


These are the revised definitions of ¥(f) and 
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increasingly important as users require the 
specification of phase noise near the carrier vhere 
the phase excursions are large compared to 1 radian, 
or at Fourier frequencies vhich exceed the bandwidth 
of typical circuit elements. 


The above measures provide the most powerful (and 
detailed) analysis for evaluating types and levels of 
fundamental noise and spectral density structure in 
precision oscillators and signal handling equipment 
as it allovs one to examine individual Fourier 
components of residual phase (or frequency) 
modulation. 


IIL_A. Ivo Oscillator Method * 


Fig. 1 shows the block diagram for a typical schese 
used to measure the phase noise of a precision source 
using # double balanced mixer and a reference source. 
Fig, 2 illustrates « similar technique for measuring 
only the phase noisi dividers, 
amplifiers, and p. very 
{mportant that the substitution oscillator be at the 
sane drive level, impedance, and at the equivalent 
electrical length from the mixer as the signal coming 
from the reference oscillator, This is dramatically 
tllustrated in Fig. 3, discussed below. The output 
voltage of the mixer as a function of pha: 
deviation, 4¢, between the two inputs to the mixer is 
nominally given by 


Vue = K cos a6 (8) 


Near quadrature (90° phase difference) this can be 
approximated by 


2n-1 
Nour = KgSd, where 66 © [46 - 


*) <O.1 (9) 


where n is the integer to make 6¢ ~ 0. The voltage to 
e conversion ratio sensitivity, Ky, {s dependent 
on the frequency, the drive level, and impedance of 
both input signals, and the IF termination of the 
aixer (4). The combined spectral density of phase 
noise of both input signals, che noise of the mixer, 
and the amplitude noise from the IF amplifiers is 


wee 
ang) om 


Fig. 1. Precision phase measurement system using 
spectrum analyzer. Calibration requires a recording 
device to measure the slope at ‘the zero crossing. 
The accuracy is better than 0.4 dB frow dc to 0.1 v, 
Fourier frequency offset from the carrier v,. 
Carrier frequencies from a few Hz to 10‘! Hz can be 
accommodated with this type of measurement system 
[4]. 
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given by 


v, (£) 
s,(£) = |—— ‘ 
(EDK, Bu 


(10) 


Measurement of S(t) for Two Amplifiers 


see) 


Fig. 2. Precision phase measurement system featuring 
self calibration to 0.4 dB accuracy from éc to 0.1 v, 
Fourler frequency offset from carrier. This system 
is suitable for measuring signal handling equipment, 
multipliers, dividers, frequency synthesizers, as 
well as passive components (4) 


PHASE SENSITIVITY (Virad) 


wo mo 0 1 2 § 
FREQUENCY (kHz) 


Fig. 3. Double-balanced mixer phase sensitivity at 5 
Mz as a function of Fourier frequency for various 
output terminations, The curves on the left were 
obtained with 10 ail drive while chose on the right 
were obtained with 2 mi drive. The data demonstrate 
a clear choice between constant, but low sensitivity 
or much higher, but frequency dependent sensitivicy 
(41. 


where V,(f) is the RMS noise volt, at Fourter 
frequency f from the carrier measured after IF gain 
G(£) in a noise bandvidth BW. Obviously BY must be 
small compared to £. This is very important vhere 
S,(£) is changing rapidly with f, e.g.. S,(£) often 
varies as €* near the carrier. In Fig. 1. the 
output of the second amplifier following the mixer 
contains contributions from the phase noise of the 
oscillators, the noise of the mixers, and the post 
amplifiers for Fourfer frequencies much larger than 
the phase-lock loop bandwidth. In Fig. 2, the phase 
noise of the oscillator cancels out to a high degree 
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(often more than 20 dB). Termination of the mixer IF 
port with $0 @ maximizes the IF bandwidth, however. 
termination with reactive loads can reduce the mixer 
noise by ~ 6 4B, and incr: Ky by 3 to 6 dB a 
shown in Fig. 3 [4]. Accurate determination of Ky 
can be achieved by measuring the slope of the zero 
crossing in volts/radian with an oscilloscope or 
other recording device vhen the two oscillators are 
beating slowly. For some applications the digitizer 
in the spectrum analyzer can be used to ure both 
the beat period and the slope in V/s at the zero 
crossing. The time axis 1s easily calibrated since 
one beat period equals 2 radians. The slope in 
volts/radian is then calculated vith a typical 
accuracy of 0,2 dB. Estimates of K, obtained from 
measurements of the peak co peak output voltage 
induced can introduce errors as large as 6 dB in 
5,(£) even if the amplitude of che other harmonics {s 
measured unless the phase relationship {s also taken 
into account [4]. S,(f) can be made independent of 
the accuracy of the spectrum analyzer volt. 
reference by comparing the level of an externally IF 
signal (@ pure tone {s best), on the spectrum 
analyzer used to measure V, with the level recorded 
on the device used to measure Ky 


The noise bandwidth of che spectrum analyzer also 
needs to be verified. This calibration procedure 1s 
sufficient for small Fourler frequencies but looses 
precision and accuracy due to the probl. 
illustrated in Fig. 3 and the variations of amplifier 
gain vith Fourier frequency, If measurements need to 
be made at Fourler frequencies near or below the 
phase-lock-loop bandwidth, a probe signal can be 
injected inside the phase-lock-loop and the 
attenuation measured versus Fourier frequency 


Some care 1s necessary co assure that the spectrum 
enalyzer is not saturated by spurious signals such as 
the power line frequency and its multiples. 
Sometimes aliasing in the spectrum analyzer is a 
problem. If narrow speccral features are to be 
measured it is usually recommended that a flat top 
window function (in the spectrum analyzer) be used. 
In the region where the measured noise is changing 
rapidly with Fourier frequency, the noise bandwidth 
should be @uch smaller chan the measurement 
frequency. The approximate level of the noise floor 
of the measurement system should be measured in order 
to verify thac it does not significantly bias che 
Measurements or, if necessary, to subtract its e 
from che results. 


Typical best performance for various measurement 
{a ahovn in Fig. & The two oscillator 
approach exceeds the performance of almost all 
available oscillators from below 0.1 MHz to over 100 
GHz and is generally the cechnique of first choice 
because of its versatility and simplicity, Figs. 10 
Phase noise measurements on 
can be made with an absolute 
accuracy better than 1 dB using the above calibration 
procedure. Such accuracy {s not always attainable 
when the phase noise of the source exceeds that of 
the added noise of the components under test (si 
Fig. 2). The use of specialized high level aixers 
with multiple diodes per leg increases the phase to 
voltage conversion sensitivity, K, and therefore 
reduces the contribution of IF amplifier noise (5] as 
shown in Fig. 4, Phase noise measurements can 
generally be made at Fourier frequenc 
approximately de to 1/2 the source frequency, 


The 
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major difficulty is designing « mixer terminations to 
remove the source frequency from the output signal, 
which would generally saturate the low noise 
amplifiers following the aixer, without degrading the 
gnal-to-noise ratio. As mentioned earlier the 

phase noise spectrum is quite likely asymmetric vhen 
Z exceeds the bandvidth of the cuned ctreuits in the 
device under test. For example one expects that the 
phase noise at 1/2v, is different than the phase 
noise at 3/2v). 


Comparison of Noise Floor 
for Different Techniques 


cS 

> 

a 

10-20 
o 10°’ 10? 1? 10% 105 108 
Fourier Frequency (Hz) 

Fig. 4 

Curve A. The noise floor S,(f) (resolution) of 
typical double balanced mixer systems (e.g 
Fig. 1 and Fig. 2) at carrier frequencies 
from 0.1 MHz co 26 GHz. Similar 
performance possible to 100 GHz [5]. 

Curve B. The noise floor. S,(f), for a high level 
mixer [5]. 

Curve C. The correlated component of S$,(f) between 
two channels using high level mixers [5}. 

Curve D. The equivalent noise floor S,(f) of a 5 to 
25 MHz frequency multiplier. 

Curve E. Approximate phase noise floor of Fig. 8 
using a 500 ns delay line 

Curve F. Approximate phase noise floor of Fig. 8 


where @ 1 as delay has been achieved by 
encoding the signal on an optical carrier 
and transmitted it across a long optical 
fiber to a detector. 


Most double balanced mixers have a substantial non- 
Linearity chat can be exploited to make phase 
comparison between the reference source and odd 
multiples of the reference frequency. Some mixers 
even feature internal even harmonic generation. The 
measurement block diagram looks identical to that of 
in Fig. 1, except that the source under test is st an 
odd (even) harmonic of the reference source, This 
nethod is relatively efficient (as long as the 
harmonics fall within the bandwidth of the mixer) for 
gultiples up to x5 although multiples as high as 25 
have been used. The noise floor is approximately 
degraded by the asount of reduction in the phase 
sensitivity of the mixer. The phase noise of the 


reference source {s also higher at the multiplied 
frequency as shown in Section III.F below. 


ili_B. Enhanced Performance Using Correlation 
Techniques 


The resolution of the many systems can be greatly 
enhanced (typically 20 dB) by using correlation 
techniques to separate the phase noise due to the 
device under test from the noise in the mixer and IF 
amplifier (5, 11]. 


For purposes of illustration, consider the scheme 
shown in Fig. 5. At the output of each double 
balanced mixer there is a signal which is 
Proportional to the phase difference, a¢, between che 
two oscillators and a noise term, Vg, due to 
contributions from the wixer and amplifier. The 
voltages at the input of each bandpass filter are 


V, (BP filter input) = G, 4¢(t) + C, Vp, (t) qt) 
V, (BP filter input) = G, a¢(t) + C,¥p,(t), 
where Vy, (t) and Vy,(t) are substantially 

ted and C, and C, are constants. Each 


filter produces a narrow band noise function 
around {ts center frequency £: 


V, (BP filter output) = G,(S,(f)]* B,* cos [2eft + 
o(t)) 
+ C, [Syp, (£))* By* cos [2efe + ny (t)) (2) 


V, (BP filter output) = G,[S,(£)]* B,* cos [2#ft + 
v(t)] 


+ Cy (Synz (£)]* By cos (2eft + mp (t)] 
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Fig. 5. Correlation phase noise measurement system. 
where B, and B, are the equivalent noise bandwidths 
rs 1 and 2 respectively. Both channels are 
filtered in order to help eliminate aliasing 
and dynamic range problems. The phases v(t). n, (t) 
and n,(t) take on all values between 0 and 2 with 
equal likelihood. They vary slowly compared to 1/f 
and ai stantially uncorrelated. When these two 
are multiplied together and low pass 

d, only one term has finite average value. 
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The output voltage is 


wv 


fut 


= 4 G,G,S,(£) By 4B,* + D,<cos[p(t)-n, (t)]> (13) 
+ D,<cos(¥(t) - n,(t)]> + D,<cos(n,(t)-n,(t)]>, 

so that S,(f) is given by 

(20ve Cf) 


5,(£) = (4) 


6,0, JB, By 


For times long compared to B,“"B,"* the noise terms 
D,, Dy and D, tend towards zero as /t. Limits in the 
reduction of these terms are usually associated with 
harmonics of 60 Hz pickup, dc offset drifts, and non- 
Mnearities in the multiplier. Also if the isolation 
amplifiers have input current noise, they will pump 
current through the source resistance. The resulting 
noise voltage will F coherently on both channels 
and cannot be distinguished from real phase noise 
becveen the tvo oscillators. One half of the noise 
pover appears in amplicude and one half in phase 
modulation. 


Obviously the simple single frequency correlator used 
in this example can be replaced by a fast digital 
system vhich simultaneously computes the correlated 
phase noise for a large band of Fourier frequencies. 
Typical results show a reduction in notse floor of 
order 20 dB over the noise floor of # single channel 
(See Fig. 4), The great power of this technique is 
that it can be applied at any carrier frequency where 
are available double balanced mixe The primary 

i ations come from the bandwidth and non- 
Linearities in the cross correlator ($,11] 


UL_t. Reference Phase Hodulation Method 


Another method of determining S,(f) uses ph 
modulation of the reference oscillator by # known 
amount. The ratio of the reference phase modulation 


to the rest of the spectrum then can be used for 4 
re 


tive calibration. This approach can save an 
jormous amount of time for measurements vhich are 
repeated great many times An adaptation of chis 
approach {s utilized in the new NBS phase noise 
system described in section IV belov 


IiL_2_Frequency Discriminator Methods 


It {s sometimes convenient to use a high-Q resonance 
directly as a frequency discriminator as shown in 
Fig. 6. The oscillator can be tuned 1/2 linewidth 
(v,/2Q) away from line center yielding a detected 
amplitude signal of the form 


Veuve = G(EDKgQay(£) [V +e(e)) as) 
This approach mixes frequency fluctuations becween 
the oscillator and reference resonance with the 
amplitude noise of the transmitted signal. By using 
amplicude control (e.g. by processing to normalize 
the data), one can reduce the effect of amplitude 
nol. {5} The measured noise st the detector is 
then related to the phase fluctuation of the 
reference resonance by 


S,(f) = 6) 


£Qk4G(£) Bu 2Q 
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VCO FREQUENCY 
Fig. 6, High-Q resonance used as @ frequency 
discriminator. Note that the peak response is 


displaced from the center of the resonance by about 
the half bandwidth 


This approach normally has the limitations that £ 
gust be small compared to the linewidth of the 
cavity, and the effecc of residual amplitude noise is 
difficult to however, no reference source is 
needed. The calibration factors G(f)KdQ can be 
Measured even for Fourier frequencies larger than 
¥2/2Q by stepping the source frequency an amount dy 
(which ts small compared to 1/2Q) and measuring the 
output voltage versus the modulation frequency, f 


Differential techniques can be used co measure the 
inherent frequency (phase) fluctuations of two high-Q 
resonators as shown in Fig. 7 [7|, The output 

voltage is of the form ¥,,, = 2QK,G(f) dy(£) The 
phase noise spectrum of the resonators is then 
obtained using Eq. 4 


weWy(f)] 1 Me 
— i<— (17) 
2QfK,C(£) BY 2Q 


S,(f) = 


Measurement of the inherent Phase Noise in High-O Resonators 


Fig. 7. 
pair of high-Q resonators 
phase noise of the source tends to cancel out, 


Differential frequency discriminator using a 
In this approach the 


TN-133 


436 


The phase noise in the source can cancel out by 20 to 
40 4B depending on the similarity of resonant 
frequencies Q’s and the transmission properties of 
the two resonators. This approach was first used to 
demonstrate that the inherent frequency stability of 
precision quartz resonators exceeds the performance 
of most quartz crystal controlled osctllacors [7]. 


If only one resonance is used, the output includes 
the phase fluctuations of both the source and the 
resonator. The calibration 1s accomplished by 
stepping the frequency of the source and measuring 
the output voltage, i.e., AV = C(E)K'(£) ay,. From 
this measurement the phase spectrum can be calculated 
as 


Vy (£) 271 
sf) = | ——— ] |—] + (as) 
£ K(f) By 


Fig. 8A shows one method of implementing this 
approach at X-band, The cavity has a loaded quality 
factor of order 25,000, Fig, 8B shows the measured 
frequency discriminator curve. Note that Ki(£) is 
constant for f<v/(2Q) and decreases at values of £ 
larger than the half bandwidth of the resonance as 


1 
gg —_— ag) 
2Qf ? 
1+ (—) 


Me 
The frequency dependence shown in eq. (19) can be 
accurately determined by measuring 4V when stepping 
the source an amount av, which is small compared co 
vo/Q, versus the modulation frequency, £. This 
approach has poor resolution near the carrier and 
Limited high frequency response. Therefore the 
measurement of phase from close to the carrier out to 
108 of the carrier could require a large set of 
cavities with different Q factors. In order to 
achieve the required Q factor for close in 


incoming signal (7-10) as shown in Fig. 9. 
The mixer output is of the form 
Your * 2ntgkarody (20) 


and the input phase noise is given by 


1 1 
S,(£) = —. &— (ay 
By "4 
approach is often used frequencies 
when only one oscillator is available. In this 


technique the ability to resolve phase noise close to 
the carrier depends on the delay time. For example, 
1f £ = 1 He and ry = 500 ns, chen, (2efr,)? ~ 10°! 
The noise floor is 110 4B higher at f = 1 Hz than 
that of the two oscillator method, decreasing as 
1/f2, Recent advances make it possible to encode the 


rf signal on an optical signal vhich then can be 
transmitted down an optical fiber to achieve delays 
up to the order of 10°? 5 with an increase in the 
noise floor to approximately -140 4B relative to 1 
rad? /iz. The noise floor can be reduced by -20 to 40 
4B using the correlation techniques described above 
{11). Note that the range of Fourier frequencies is 
usually limited to less than - 1/ry. This technique 
normally has good resolution over 1h to 2 decodes in 
Fourier frequency. Therefore, measurements of phase 
from close to the carrier out to 108 of the 
Tequire a large set of different delay lines 
and hardvare including optical delay lines, 
associated lasers, modulators, and detectors. 


Measurement of Phase Noise using a High-Q Cavity 


ve CURE ay 
10.8 GHz OSC jem 


ie 


sf» (< 
rer 


106 GHz 
Frequency 


500 kHz 


+500 KHz 


8. A. block diagram of a high Q resonator used 
frequency discriminator. B, Frequency 
riminator curve for the scheme shown in A used at 
X-band with a cavity having # loaded quality factor 
of approximately 25,000 


Measurement of S, (f) Using a Delay Line 
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Fig. 9. Delay line frequency discriminator. 
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Phase Noise of Quartz Oscillators 
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Fig. 10. Phase noise performance of selected quarcz 
oscillators, The LY 5 MHz oscillator is driven at a 


high level to reduce the wideband noise vhile the LD 
5 MHz oscillator is driven at a lower level to obtain 
low phase noise close to the carrier 


Phase Noise at X Band 
of Multiplied Quartz Oscillators 


OLN SMHz 
LN 100MHz 
* LO SMHz 
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Sy(f in dB rel to 1 rad/Hz 
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Fig. 11. Phase noise of the oscillators of Fig. 10 
if multiplied to X-band in a perfect frequency 
aultiplier 


U1L_E£_Multinlication/Diviston 


The use of perfect frequency multipliers (or 
dividers) between the signal source and the double 
balanced mixer Increases (decreases) the phase noise 
[12] as 


2 
ve 

Suv, (£) .| | Sov (ED (22) 
4 


where v, is the initial carrier frequency and v, is 
the final carrier frequency This can be used to 


either increase or decrease the phase sensitivity of 
the mixer system, Fig. 4 shows the noise of a 


Added Phase Noise by Amplifiers 
-100 
A) MESFET 106 GHz 


Bl MESFET 14 GHz 
€,0 Siup to) GHz 


-130 
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& 


Log Fourier Frequency (Hz) 


Fig. 12, Curves A and B show the phase noise added 
by selected CaAs MESFET amplifiers. Curve C shows 
the phase noise added by @ typical common emitter 
silicon bipolar transistor with a “good” rf bypass on 
the emitter lead, Curve D shows the typical 
perforrance of the amplifier with # small 
unbypassed impedance (approxi: 
1/transconductance) in the et The added 
phase noise is generally independent of frequency 
over a very large range 


specialized 5 to 25 MHz multiplier referred co the $ 
MHz input, A potential problem with the use of the 
multiplier approach comes from exceeding the Linear 
Tange of the mixer, Once che phase excursion, &¢ 
exceeds about 0 1 radian, non-linearities start to 
become important and at 4¢ ~ 1 radian, the 
Beasurement is no longer valid [12]. An additional 
practical problem is that low noise multipliers are 
usually narrowband devices Each significantly new 
frequency generally requires a new ser of frequency 
multipliers 


IV_A._The New NBS Phase Noise Measurement Systems 


The new NBS phase noise measurement systems are a 
combination of the traditional two oscillator 
approach shown in Figs. 1 and 2 plus the reference 
phase sodulation technique mentioned in section L1IC 
The complete block diagram is sketched in Fig. 13. 
This approach yields the widest possible bandwidth 
and che lovest phase noise of a single channel 

system. It does, however, require the use of two 
sources for oscillator measurements, From hardvare 
considerations we generally use 3 different phase 
noise measurement systems. Test set A accepts 
carrier frequencies from $ to 1300 MHz and can 
geasure the phase noise from 1 Hz to about 108 of the 
catrier or a maximum of 100 Miz, Test set B accepts 
carrier frequencies from 1 GHz to 26 GHz and can 
@easure the phase noise from 0.01 Hz to about S00 MHz 
from the carrier. Test set C accepts carrier 
frequencies from about 2 to 26 CHz and can measure 
the phase noise from 0.01 Hz to 1 GHz from the 
carrier. Test set D accepts carrier frequencies from 
33 to 50 GHz in WR22 waveguide and can measure the 
phase noise from 0.01 Hz to about 1.3 GHz from the 
carrier 


The construction of the phase modulator between the 
reference source and the mixer vill be described in 
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detail elsewhere (12]. The low pass filter section 
is used in order not to saturate the amplifiers with 
the carrier feedthrough signal from the mixer. One 
dc amplifier is used for phase noise measurements 
from de to 100 kHz from the carrier. One ac 
amplifier is used for phase noise measurements from 
$0 kHz to 32 Miz. This range is well matched for one 
of our spectrum analyzers. The wideband ac amplifier 
has a bandwidth of 50 kHz to 1.3 GHz and is used vhen 
the desired measurement bandwidth exceeds 32 MHz. 

The wide bandvideh spectrum analyzer also provides @ 
convenient vay to observe the gross features of the 
output phase noise and to identify any major spurious 
outputs if present. In order to obtain the most 
accurate measurement of the phase noise it is, 
however, necessary to measure the amplitude of the 
first IF signal at about 21 MHz in order to avoid the 
variations in gains of the log amplifiers with 
various environmental factors, 


Generalized block diagram of the new NBS 
surement systems. The phase noise of 
carrier frequencies from 1 MHz to 100 GHz can be 
weasured by varying the components in the phase 
shifters and mixers. Dedicated measurement systems 
covering 5 MHz to 50 GHz are described in the text 


TY_B. Measurement Sequence 


1) The output power of the two sources to be 
measured {s typically set to between +5 and + 13 dBa 
at the mixer. This cal into account the insertion 
loss of the phase modulator. If the oscillators 
don't posses sufficient internal isolation to prevent 
unvanted frequency pulling, isolators (or isolation 
amplifiers) enerally ins becveen the 
sources and the mixer. 


2) The absolute sensitivity of the mixer and the de 
amplifier for converting small changes in phase to 
voltage changes 1s determined in a way similar to the 
traditional method, namely by allowing the two 
oscillators to slowly beat. The output of the de 
amplifier is recorded by the digitizer in the FFT 
connected to the de amplifier in order to accurately 
determine the period of the beat, In test sets C and 
D an additional 50 MHz digitizer {s used to average 
and record the beat frequency. The time scale of the 
digitizer is chen expanded to approximately 108 of 
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the beat period and pretrigerred at about -2V in 
order to accurately determine the slope of the output 
in volts per radian. This calculation, shown in eq. 
(23) below, is typically accurate t 28 or 0.2 dB. 


K = Volts/Second) (Period/(2=) a) 
3) The two sources to be measured are phase locked 
together with sufficient bandwidth that the phase 
excursions at the mixer are less than 0.1 radian. 
The necessary phase lock gain is calculated using an 
estimate for the noise of the oscillators and the 
tuning rate for the reference oscillator. This is 
then verified by noting the peak to peak excursions 
of the de amplifier and using the measured conversion 
sensitivity measured in step 2 above. If the peak 
phase excursions are in excess of 0.1 radian, then 
the phase lock loop bandwidth is ineri at 
possible) in order to satisfy this condition. 


4) The modulator is driven by « reference frequency 
(typically at +7 to +10 dBm) which steps through the 
frequencies of interest and the detected RMS 
recorded on the appropriate spectrum 
analyzer. This approach accurately yields the 
relative gains of each amplifier and its respective 
spectrum analyzer since it automatically accounts for 
the effect of the phase lock loop and residual 
frequency pulling as well as the termination of the 
mixer and the variations in gain of the various 
amplifiers vith Fourier frequency, The amplitude of 
the phase modulation on the carrier is constant in 
amplitude to better than + 1.5 4B (typically 40.243 
for £ < $00 Miz) for reference frequencies de to 
about 108 of the carrier frequency or # maximum of 1 
GHz. Initial measurements of the prototype 
modulator are shown in Fig. 14 


This measurement is then combined with the 
asurement of the absolute mixer sensitivity 
multiplied by the gain of the de amplifier described 
in step 2 above. The absolute gain of all the 
amplifiers shown in Fig. 13 can generally be 
determined to an accuracy of t 0.3 4B (1.5 4B for 
Fourler frequenci: from 500 MHz co 1 GHz) over the 
Fourler frequencies of interest 


5) Next the spectral density function of the FFT is 
verified. The level of che noise determined by the 
FFT for the input of the noise source amplifier 
sequentially shorted to ground, connected to ground 
through a 100 kf metal film resister, and connected 
to ground through 200 pF, is then recorded. From 

these data one can determine the inherent noise 
voltage and noise current of the noise source 
amplifier plus the FFT as well as the noise of the 
resistor to about t 0.25 4B which ts the stated 
accuracy of the FFT. This primary calibration of the 
FFT can be carried out from about 20 Hz to over 50 
kHz. Above $0 kHz, the noise gain of the amplifier 
we used contributes a significant amount of noise 
Wich some compensation the noise is flet to within 
20.2 4B from 20 Hz to 100 kHz. Next the noise source 
svitched into the output of the mixer and the 
relative noise spectrum of all the spectrum analyzers 
is calibrated by knowing their relative ¢ 
procedure verifies the voltage referenc: 
bandwidths of the various spectrum analyzers. 


6) The noise voltage is recorded on the thre 
spectrum analyzers over the Fourier frequencies of 
interest, generally the same one used in step & 


TN-136 


above. The measured noise voltages are scaled using 
the measured gains and the spectral density of phase 
noise calculated. The overlapping ranges of the 
various spectrum analyzers allows one the opportunity 
to compare the seasuresents on the three spectrum 
analyzers. Typically one can obtain S,(f) of the 
escilletor pair to an accuracy of about + 0.6 dB at 
Fourier frequency above 100 Hz. The agreement with 
Tepeat measurements is often of order * 0.2 4B as 
shown in Fig. 15. 


7) The noise floor of the system 1s determined by 
with one 


measurements 
floor is within 13 dB of that measured in step 7 
above, corrections are sade to the measurement data 
to remove the bias generated by the noise floor. 


Measurements of the amplitude accuracy of the phase 
modulation side bands generated by the prototype 
phase modulators are summarized in Fig. 15. The same 
modulator was used for carrier frequencies from 5 to 
300 Miz. The error in che phase modulation amplitude 
is less than 0.5 4B for modulation frequencies from 
de to 108 of the carrier. The 10 GHz modulator also 
maintains an accuracy of better than 0.5 dB out to 
500 MHz from the carrier. At 1 GHz the modulation 
amplitude is 1.5 dB high. Once this is measured it 
ean be taken into account in the calibration 
procedure. The 45 Giz modulator results shown in 
Fig. 15 should be attainable over the entire WR22 
vavequide bandwidth. 


The performance that can be obtained with this 
Beasurement technique is illustrated by actual ph 
noise data on oscillator pairs shown in Figs. 15 and 
16, Typical accuracies are +0.6 dB with « noise 
floor at about - 175 dB relative to 1 radian? /Hz. 

The corrections applied to the raw data at 10 GHz are 
shown in Fig. 17. At low frequencies the effect of 
the phase-locked loop is apparent while at the higher 
frequencies the roll-off of the amplifiers are 
important. These effects have been emphasized here 
in order to examine the ability of the calibration 
Process to correct for instrumentation gain 
variations. 


W_Gonclusion 


We have analyzed several traditions! approaches to 
making phase measurements and found that they all 


accuracy of order 1 dB. By combining several of che 
techniques and adding phase modulator vbich (s 
exceptionally flat from de to about 108 of che 
carrier frequency, ve have been able to achieve 
excellent phase noise floors, bandvidths of at le 
108 of the carrier, and accuracies of order 20.6 dB. 


Phase Modulation Error in dB 
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00% oF 7 a) 700 
Modulation Frequency (1) in % of Carrier Frequency 


Fig. 14 Measurement of the amplitude error of 
modulation signal versus Fourier frequencies f, for 
these prototype phase modulators. Curves labeled 5, 
100, and 300 MHz vere obtained with the sodulator 
used tn 5 to 1,300 Miz test set. The curve ed 
10 GHz was obtained with the modulator for the 2 to 
26 GHz test set. The curve labeled 45 GHz was 
obtained with the WR22 cest ser 


Two Oscillator Calibration Test @ SMHz 


N -1% 
b 
Ss + System A 
8 * System B 
- 1B Sysiem B+ hia 
2 we 
s 
o 
D 
£ 
Sc -“ 
= 
a 

we 100 Hr Th? 
Log Fourier Frequency (M2) 
Fig. 15 Demonstration of calibration accuracy for 


two oscillator concept. The curve labeled System A 
shows the measured phase noise of # pair of 5 MHz 

oscillators using the test set shown in Fig. 13. The 
curve labeled System B shows the measured phase noise 
of scillators using a totally 
separate measurement sys with the oscillators held 
in phase quadracure with the measurement test set of 
A. The curve labeled System B + 1/4 shows the phase 
noise of the same pair of oscillators using test set 
B with and tra cable | 
ch signal path. The ag: 
curves is in the worse case t 0.15 4B 
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Phase Noise at X Band 


S,{f) in dB rel to 1 rad"Hz 


1 2 3 4 5 6 7 6 9 
Log Fourier Frequency (Hz) 


Fig. 16 Phase noise measurement on a pair of 10.6 
GHz sources using the new NBS measurement technique 


o Calibration Correction 

Do 

& 

< -10| 

2 

5 3 4 5 6 7 8 9 
é Log Fourier Frequency (Hz) 


Fig, 17 Correction factor applied to the measurement 
data made to obtain the results of Fig. 16 
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1. Intreduesten 


Techniques to characterize and to measure the frequency 
and phase instabilities in f 
and in ved radio 
tance to all manufacturers 
time technology. 


nd users of Frequency and 


In 1964, a subcommictes on frequency stability vas form- 
ed within the Institute of Electrical and Electronics 
ineers (IEEE) Standards Committee 14 and, Later (in 
1966), in the Technical Committee on Frequency and Tipe 
within the Soe € Instrumentation and Measurement 
(SIM), to prepare an IEEE standard on frequency stabili- 
ty, In 1969, this subcommittee completed a document 
Proposing definitions for measures on frequency and 
phase stabilities (Barnes. ec al., 1971). The 
mended measures of instabilities in frequency g 
have gained general acceptance among frequency 
users throughout the world. 


recom- 


In chis paper, measures in the tine and in the frequency 
domains are reviewed. The particular choice as to which 
domain is used depends on the application. However, the 
users are reainded that conversions using mathesatical 
fi one domain to the 


‘other can pi 


Most of the major manufacturers now specify inscabilicy 
characteristics of thetr standards in Ceras of these 
Tecoamended measures. This paper chus defines and 
formalizes the general practice of more than a decade 

2. Meagurea of Frequency and Phase Ingcabilicy 
Frequency and phase instabilities shall be measured in 
fas of the instantaneous, normalized frequency depar- 
ture y(z) from the nominal frequency », and/or by phase 
departure ${z), in radians, from the nowinal phase 2ev,¢ 
as follows: 


— dats) 
ha a a 2a, 
xe HE 

‘0 


where x(z) is the phase departure expressed in units of 
tine 


In the frequency dosain, frequency and phase {n- 
stabiitzy ts defined by any of the folloving one- 
sided spectral densities (the Fourier Frequency 
ranges froa 0 to): 


® See Appendix Note # 17 419 


5,(£) of y(e) 
$,(£) of ¢(c) 
$5 (£) of de> 
$,(E) of x(e). 


These speccral densities are related by the 
equations 


2 
a 
s,(0 v2 $48) 
0 
Sct) = Caaf)? sce) 
3 * 


5,(0 = sity). 
co 
Qavy 


A device or signal shall be characterized by « plot 
of spectral density vs, Fourler frequency or by 
tabulacing discrece values or by equivalenc weans 
such as a statemenc of power law(s) (Appendix I). 


According to the conventional definition 
(Kartascho£f, 1978) of 2(f) (pronounced “script 
elit), £(£) ts che raclo of the pover in one side- 
band due to phase modulation by noise (for a t Hz 
bandwidth) co che cocal signal pover (carrier plus 
sidebands), that is, 


tcp = PARE density, oe phase-rolse onchulation sidebar Me 
Total signal pose 


The conventional definition of £(f) ts relaced to 
8,(£) by 


2(f) = 4S, (6) 


only L€ the mean squared phase deviation, <s*(f)> = 
the integral of S,(£) f to =, ts auch saller 
than one radian. In other vords, chis relationship 
is valid only for Fourter frequencies £ far enough 
from the carriec frequency and is alvays violated 
near the carrier. 


Since $,(£) 1s the quancicy chat is generally 
sured in frequency standards mecrology, and £(£) 
has become the prevatling measure of phase noise 
among manufacturers and users of frequency stan- 
dards. £(£) 13 redefined as 


£2) AS, CED 


This redefinition {s intended co avoid errone 
use of £(£) im situations vhere che saail angle 
approximation 1s not valid. In other words, $,(£) 
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is the preferred measure, since, unasblguously, it 
alvay i 


b. 


In the time domain, frequency instability shall be 
defined by the tvo-saaple deviacton o,(r) which {3 
the square root of the two-sampli ariance @,7(r). 
This vartance, o,7(r), has no dead-time becween the 
frequency samples and is also called che Allan 
variance. For the sampling tise r, ve vric 


2 tle 52 
at 23 (Geet -¥) ) 


y, eb fe ere = Ake | 


The symbol <> denotes an infinite tine avers; 
In practice, the requirement of infinite time 
average is never fulfilled: the use of the 
ing teras shat A Crna for finite time 

averages. are time residual mea~ 


suresencts ards cf eth pis 2 » k=1,2,3 
that ecxtd sampfing race which 


and 1/r ts the noall 
gives zero dead tine betveen frequency aeasure- 
Bencs, “*Residual* taplies che known systematic 


effects have been removed. 


059° 


Tf dead cine exists becveen che frequency deparcure 
Measurements and this is ignored in the compucation 
of o,(r), resuleing instability values will be 
Dlased (excepe for whice frequency nolse). Sone of 
che biases have been studied and some correction 

jes published (Barnes, 1969; Lesage, 1983; 
Barnes and Allan, 1988}. Thecefore, the tera ¢,(r) 
shall not be used to describe such blased measure- 
ments, Rather, if biased instability measures 
made, the information in the references should be 
used Co report an undlased estigate 


T€ the initial sampling race ts specified as 1/r,, 
then it has been shown that, in general, we may 

) using 
This 


obtain a more efficient estisace of , 
vhat 1s called ‘overlapping estimaces 
estimace Ls obcained by coapucing 


Ne2o 
a ig £ 
2¢¥-2ayr? 


oir = (x, 


ie2a 2 
fal 


where N fs che number of original cige residual 
@easurenencs spaced by 1, 1, where M ts the 
number of original frequency seasuragencs of sample 
cise r,) and r= m 


From the above equation, ve see chat 9,2 (r) acts 
Like a second-difference operator on the tine 
deviation residuals--providing a stationary measure 
of che stochastic behavior even for nonstationary 
processes. Addictonal variances, which may be used 


to describe frequency instabilities, are defined in 
Appendix II. 


also inown 
as Ciae Interval error, TIE, observed over a tise 
starting az time €, and ending at ty+t 

shall ba defined «: 
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toot 
E(t) = x(tote) - (ty) = It yle*)der. 


For fairly staple models. 
provide efficient estisates of the TIE (Draper and 
Smith, 1966; CCIR, 1986). In general, there are 
Gany estimators possible for any statistical quan- 
ticy. Ideally, ve vould Like an efficient and 
unbiased estimator. Using che time domain measure 
@,7(r) defined in (b), the following estisate of 
the standard deviation (RS) of TIE and its asscc- 
faced systematic departure due to « Linear 
frequency drift (or its uncertainty) can be used to 
predict « probable cise interval error of a clock 
hypchronized at toty00 and Left free running there- 
after: 


aston analysis can 


a xte,) 
BNSTIE, wet [Bees +e cane et] 
0 


where “a* is the noraalized Linear frequency drift 
pec unit of Cize (aging) or the uncertainty in che 
drift estimate, ¢, the cvo-sample deviation of 
the initial frequehcy adjustaent, ¢,(r) the two- 
sample deviation describing the random frequency 
inscabiitcy of the clock at ter, and x(t) is che 
initial synchronization uncertainty, The third 
tera in the brackets provides an optimum and un- 
biased esclmate (under the condition of an optiqum 
(RMS) prediction method) in the cases of vhice 
noise FX and/or random valk FX. The third term is 
foo optiaistic, by about a factor of 1.4, for 
flicker not) . and coo simiscic, by about « 
factor of 3, for white nolse PM. 


This estinate is a useful and fairly simple approx- 
ization. In general. a sore couplece error 

analysis becomes difficult; if carried out, such an 
analysis needs to include che sechods of time pre- 

diction, the uncertainties of the clock parameter: 
using che confidence Limits of measurements defined 
Delow, the detailed clock noise aodels, systematic 

ete, 


for a,(r) can be made from a finite data set 
with M measurements of y, as follows: 


or, 


‘The 68 percene confidence interval (or error bar), Ty. 
for Gaussian noise of a (r) obtained 
cof sasples can be 


I, = 0, (r)<a* 
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AAD 
oon 
eco 
vue 
ess 


1 
a 
As an example of the Gaussian sodel with M=100, @ = -1 


(flicker Erequancy noise) and ¢,(r = 1 second) = 10°17, 
we may wrice: 


Ty = 9, ¢r}9(0.77)#(100)"* = 2, (+) *(0.077) 


which gives: 
-12, 


(ral nd) = (1 + 0.08) x 10 


Tf M is small, chen che plus and minus confidence inter- 
vals become asyanetric and the «, coefficients are not 

. these confidence intervals can be calcu- 
lated (Lesage and Audoin, 1973). 


outlined above, 
mate can be 


shown to given above 


5. Recommendations foc Charactecizing or Reporcing 


4. Nonzandom phenomena should be recogni: 
exaaple 


© any observed time dependency of th 
tistical measures should be stat 


© the mechod of modeling systematic 
behavior should be specified (for ex- 
ample, an estimate of the Linear fre- 
quency drift vas obtained from the 
eseffictants of a linear least-squares 
regression to M frequency urements, 
each with a specified averaging or sample 
time 7 and measurement bandwidth f,); 


© the environmental sensitivities should be 
stated (for example, che dependence of 
frequency and/or ph. on teaperacur: 
Gagnetic field, baromecric pressure, 
vibeation, ete.); 


b. Relevant measurement or specification 
parameters should be given: 


0 the method of measurements; 


° the characteristics of the reference 
signal: 


2 the nominal signal frequency v,; 


2 the measurement system bandwidth f, and 
the corresponding low pass fiicer 
response; 


© the total seasuremenc time and the number 
of measurements M; 


@ the calculation techniques (for example, 
details of the window funecion when 
Amwating power spectra! densities from 

time domain data. or the assumptions 
about effects of dead-tise when estimac- 
Lng che tvo-saaple deviation o,(r)); 


© the confidence of the estinate (or error 
cr) and its statistical probability 
(e.g. "theee-sigua*); 
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© the environsent during measurement; 


© = Lf a passive element, such as « crystal 
filter, is being measured in contrast to 
© Erequency and/or time generator 
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1. Power-Lav Speccral Densizics 


Power-law spectral densities are 
sonable and accurate aodels of ¢! 
in prectaton oscillator 
fluctuaclons can often be representad by cre sun of 
ingependent noise processes, and hence 


fren exployed as rea- 


‘tae ford<f<t, 
sO * ane? % 


0 for £2 f, 


o's are integers, and f, ts 
the high frequency cut-off of a low pass filter. High 
frequency divergence Ls eliainated by che rescrictions 
on f in this equation. The [dentification and charac- 
tects five nolse processes are given in 
Table 1, and shown in Fig. 1. 
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with 


New 


2. Sonverslon Between Frequency and Time Dosaln 


The operation of che counter, averaging the frequency 
for a Clas r, may be thought of filtering opeca- 
thon. The transfer funetion, H(f), of this equivalent 
fllter 1s chen the Fourier transform of the iapulse 
Fesponse of the filcer. The time domain frequency 
inacability ts then given by 


@ MT.) = f $y Cf) | MCE |? ae, 
° 


where S,(£) is the spectral density of frequency fluc- 
tuations, 1/T ts che measurement rate (T-r is the dead 
time becveen measurements). In the case of the tvo- 
sample variance |H(£)|? is 2(sin *wrf)/(er£)?. 
sample variance can thus be computed from 


£, 


bd 4 
yin 2 | s,(e) Moace 
y Garty 


Specifically, for the power lav model given, the tise 
domain measure also follows « power lav. 


TABLE 1 - The functional characteristics of the independent noise processes 
used in modeling frequency instability of oscillators 


Slope characteristics of log log plot 


Description of 7 (£) oF 
Noise Process 53 (£) 


Flicker Frequency Modulation 


ney domain 


$,(£) oF 
$,(£) 


fa p= pe 
fice roquner ost |e [= | | a | 
fs [aia 1s 4 


5 
s,(f) = Esco =he 
S( = vtnert = ae 
$.() = cae = oe 


TABLE 2 + Translation of frequency instability 


(8 = 0-2) 


oF (r) = rit 
A ee 


Mod.e,(r) = [r |’ 


frequency domain to variances in time domain and vice verse (For 2nf,r » 1) 


Deseripeion of noise process 


‘Random Walk Frequency 
Modulacion 


lFlicker Frequency Modulation 


(White Frequency Modulation 
‘Fiieker Ph 


Modulation 


White Phase Modulation 
\ 


cs/2 


ALE? Ss, (£)| rt 
BIE S,CE)Ir® 
Cle? S,(€) pert 


Djs ts, (ey ir? 


EYE?s, (£)[ 7? 


rience] 4 reinjes 


al oinje ein)e? 


la-wlerw ier 


rt on) 


aco}e? 


ve Or or > 


we Se Ot. eo 


3 ebcn) tt 


= 


ain)e 


7 acnje ain) 


Coed 


1.038 + 3 log, (2ef, 7) 


OO ————— 
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2 
en eon, ttog2 en bh 
pene + 2 toate) af, 
2,2 oy 
ae id (207? 


This tmplicicly assumes that the randos driving mech- 
anise for each term is independent of the ethers. In 
addition, there is the implicit assumption that che 
mechanism ts valid over all Fourler frequencies, vhich 
may not alvays be Crus. 


‘The values of h, are characteristic models of 
frequency noi: 


» 
for -3£a£1, andp=-2 fora2t, pare o,i(rer. 


Table 2 gives che coefficients of the cranslation among 
the frequency stability measures from time dosain co 
frequency dowain and from frequency dowain to tlae 


characteristics of the five independent nolse 
din the frequency and time domains 
scale). 


Log Sample Time, r 


Slope characteristics of the five 
independent noise processes. 


FICURS 1 
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a “Modified Vartan 
ize frequency {nscabilt- 
ties (Stein, 1983; Allan, 1987), It has the property of 
yielding different dependence on r for white phase noise 
‘and flicker phase noise. The dependence for Mod o,(r) 
is r°?/) and e°! respectively, Mod o,?(r) ts defined 
as: 


MoJo (mej -1 2 
=37——- 
Wed oy Per) = Yt tee +a) 
f=} 


ar? a? cn enn 
where N is the original number of time measureaents 
spaced by r, andr = ar, che sample tine of choice 
(NeMel). A’device or signal shall be characterized by « 
plot of #,(r) or o,#(r) or Mod o,(r) or Mod o,2(r) va, 
sampling Cle r, of by cabulacing discrece values or by 
equivalent means such as cement of pover Law: 
(Appendix I). 


2. Qcher Variances 


Several other variances have been introduced by vorkers 
in this field. In particular, before the introduction 
of che cvo-sample variance, {c was standard practice to 
use the sample variance, s*, defined 


Fe fhe sce) cmbmeneey2 ae 


In practice tc may be obtained from a set of 
ments of the frequency of the oscillator as 


for some types of noise 
erally useful 


Other variances based on the structure function approach 
can also be defined (Lindsey and Chi, 1976). For 
exasple, there are the Hadamard variance, the chree- 
sample variance and the high pass variance (Ruzaan 

1978) y ate occaslonally 
sclencific works for 
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Abstract—Consider a signal generator whose instantaneous 
output voltage Vi() may be written as 


V() = [Vo + e(0)] sin [2mrt + o(0)] 


where V, and » are the nominal amplitude and frequency, res- 
pectively, of the output. Provided that «(!) and o(f) = (dy/(dt) 
are sufficiently small for all time (, one may define the fractional 
instantaneous frequency deviation from nominal by the relation 


vy = Zo. 


‘A proposed definition for the measure of frequency stability is 
the spectral density S,(/) of the function y(/) where the spectrum 
is considered to be one sided on a per hertz basis. 

An alternative definition for the measure of stability is the 
infinite time average of the sample variance of two adjacent averages 
of y(t); that ta, if 


antl vo a 


whore + is the averaging period, fa, = (y+ Tk =0,1,2---, tia 
arbitrary, and T is the time interval between the beginnings of 
two successive measurements of average frequency; then the 
second measure of stability is 


ity) = (Gear = 0") 


where ( ) denotes infinite time average and where T = r. 
In practice, data records are of finite length and the infinite 
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¥ See Appendix Nowe ¥ B 


time averages implied in the definitions are normally not available; 
thus estimates for the two measures must be used. Estimates of 
S,P) would be obtained from suitable averages either in the time 
domain or the frequency domain. An obvious estimate for o3(r) is 


= 3? 
or) w+ lew = 
m St 2 
Parameters of the measuring system and estimating procedure 
are of critical importance in the specification of frequency stability. 
In practice, one should experimentally establish confidence limits 
for an estimate of frequency stability by repeated trials. 


Grossary or Srmpois 


BAN, Fr, w), Bias function for variances based 
B,(r, u) on finite samples of a process 
with s power-law spectral density. 

(See [13].) 

Cc. A real constant defined by (70). 

fo, Cy Real constants. 

e(t) A real, deterministic function of 
time. 

Di(r) Expected value of the squared 
second difference of z(t) with Ing 
time r. See (80). 

{ = u/2e Fourier frequency variable. 

he High-frequency cutoff of an ideal- 
ized infinitely sharp cutoff low-pass 
filter. 

hi Low-frequency cutoff of an ideal- 
ized infinitely sharp cutoff, high- 
pass filter. 

ot) A real function of time. 

A, Positive real coefficient of {* in a 
power series expansion of the spec- 
tral density of the function y(#). 

i,j, ky mn Integers, often a dummy index of 
summation. 

M Positive integer giving the number 
of cycles sveraged. 

N Positive integer giving the number 
of data points used in obtaining a 
sample variance. 

n(d) A nondeterministic function of time, 

R,(r) Autocovariance function of y(¢). 
See (58). 

r Positive real number defined by 
r= T/s. 
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vO 


20 


7 
4(r — 1) 


60) 


An intermediate term used in 
deriving (23). The definition of S$ 
is given by (64). 

One-sided (power) spectral density 
on # per hertz basis of the pure real 
function g(t). The dimensions of 
S,(f) are the dimensions of g*(t)/f. 
A definition for the measure of fre- 
quency stability. One-sided (power) 
apectral density of y(t) on a per 
hertz basis. The dimensions of 
S,(f) are Ha". 

Time interval between the begin- 
nings of two successive measure- 
ments of average frequency. 

Time variable. 

An arbitrary fixed instant of time. 
The time coordinate of the begin- 
ning of the kth measurement of 
average frequency. By definition, 
ba =44+7,k =0,1,2---. 
Dummy variable of integration; 
u & fr. 

Instantaneous output voltage of 
signal generator. See (2). 

Nominal peak amplitude of signal 
generator output. See (2). 
Instantaneous voltage of reference 
signal. See (40). 

Peak amplitude of reference signal. 
See (40). 

Voltage output of ideal product 
detector. 

Low-pass filtered output of product 
detector. 

Real function of time related to the 
phase of the signal V(¢) by z(t) = 
(e()]/(2x»). 

A predicted value for z(t). 
Fractional frequency offset of V(t) 
from the nominal frequency. See (7). 
Average fractional frequency offset 
during the kth measurement in- 
terval. See (9). 

The sample average of NV successive 
values of 9,. See (76). 
Nondeterministic (noise) function 
with (power) spectral density given 
by (25). 

Exponent of f for a power-law 
spectral density. 

Positive real constant. 

The Kronecker é function defined 
1 if r=1 


wrag— = {ti herwise. 
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a Exponent of r. See (29). 
(0) Instantaneous frequency of V(t). 
Defined by 


() = if &(1), 


Ys Nominal (constant) frequency of 
Vit). 

x(t) The Fourier transform of n(t). 

BON, T, 7) Sample variance of N averages 


of y(t), each of duration 7, and 
spaced every T units of time. 
See (10) 
T,1)) Average value of the sample vari- 
ance of(N, T, 1), 
alr) A second choice of the definition for 
the measure of frequency stability, 
Defined by o3(r) = (o(N = 2, 


T = 1,1)). 

ai(r) Time stability measure defined by 
oi(r) = r'ei(r). 

r Duration of averaging period of 
y(t) to obtain g,. See (9), 

o(t) Instantaneous phase of V(t), De- 
fined by (t) = 2evel + y(t). 

ef Instantaneous phase fluctuations 


about the ideal phase 2vof. See (2), 


MAT, 1) Mean-square time error for Doppler 
radar, See (82), 
wo = 2rf Angular Fourier frequency variable. 


I, Intropuction 


HE measurement of frequency and fluctuations in 
TT termes has received such great attention for 

so many years that it is surprising that the con- 
cept of frequency stability does not have a universally 
accepted definition. At least part of the reason has been 
that some uses are most readily described in the fre- 
quency domain and other uses in the time domain, as 
well as in combinations of the two. This situation is 
further complicated by the fact that only recently have 
noise models been presented that both adequately de- 
scribe performance and allow a translation between the 
time and frequency domains. Indeed, only recently has 
it been recognized that there can be a wide discrepancy 
between commonly used time domain measures them- 
selves. Following the NASA-IEEE Symposium on Short- 
Term Stability in 1964 and the Special Issue on Fre- 
quency Stability in the Procezpincs or rue IEEE, 
February 1966, it now seems reasonable to propose a 
definition of frequency stability. The present paper is 
presented as technical background for an eventual IEEE 
standard definition. 

This paper attempts to present (as concisely as prac- 
tical) adequate, self-consistent definitions of frequency 
stability. Since more than one definition of frequency 
stability is presented, an important part of this paper 
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(perhaps the most important part) deals with transla- 
tions among the suggested definitions of frequency sta- 
bility. The applicability of these definitions to the more 
common noise models is demonstrated. 

Consistent with an attempt to be concise, the refer- 
ences cited have been selected on the basis of being of 
most value to the reader rather than on the basis of 
being exhaustive. An exhaustive reference list covering 
the subject of frequency stability would itself be 
voluminous publication. 

Almost any signal generator is influenced to some ex- 
tent by its environment. Thus observed frequency in- 
stabilities may be traced, for example, to changes in 
ambient temperature, supply voltages, magnetic field, 
barometric pressure, humidity, physical vibration, or 
even output loading, to mention the more obvious. While 
these environmental influences may be extremely im- 
portant for many applications, the definition of fre- 
quency stability presented here is independent of these 
causal factors, In effect, we cannot hope to present an 
exhaustive list of environmental factors and a prescrip- 
tion for handling each even though, in some cases, these 
environmental factors may be by far the most im- 
portant, Given particular signal generator in a partic- 
ular environment, one can obtain its frequency stability 
with the measures presented below, but one should not 
then expect an accurate prediction of frequency stability 
in a new environment. 

It is natural to expect any definition of stability to 
involve various statistical considerations such as 
tionarity, ergodicity, average, variance, spectral density, 
ete. There often exist fundamental difficulties in rigorous 
attempts to bring these concepts into the laboratory. It 
is worth considering, specifically, the concept of sta- 
tionarity since it is a concept at the root of many statis- 
tical discussions. 

A random process is mathematically defined as sta- 
tionary if every translation of the time coordinate maps 
the ensemble onto itself. As # necessary condition, if one 
looks at the ensemble at one instant of time ¢, the dis- 
tribution in values within the ensemble is exactly the 
same as at any other instant of time ¢. This is not to 
imply that the elements of the ensemble are constant 
in time, but, as one element changes value with time, 
other elements of the ensemble assume the previous val- 
ues. Looking at it in another way, by observing the 
ensemble at some instant of time, one can deduce no 
information as to when the particular instant was chosen. 
This same sort of invariance of the joint distribution 
holds for any set of times ¢,, t, --*, t and its transla- 
tion +7, +4 ct te tr 

It is apparent that any ensemble that has a finite 
past as well as a finite future cannot be stationary, and 
this neatly excludes the real world and anything of 
practical interest. The concept of stationarity does vio- 
lence to concepts of causality since we implicitly feel 
that current performance (i.e., the applicability of sta- 
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tionary statistics) cannot be logically dependent upon 
future events (i,e., if the process is terminated some time 
in the distant future). Also, the verification of station- 
arity would involve hypothetical measurements that are 
not experimentally feasible, and therefore the concept of 
stationarity is not directly relevant to experimentation. 

Actually the utility of statistics is in the formation 
of idealized models that reasonably describe significant 
observables of real systems. One may, for example, con- 
sider a hypothetical ensemble of noises with certain 
properties (such as stationarity) as a model for a par- 
ticular real device. If a model is to be acceptable, it 
should have st least two properties: first, the model 
should be tractable; that is, one should be able to easily 
arrive at estimates for the elements of the models; and 
second, the model should be consistent with observables 
derived from the real device that it is simulating. 

Notice that one does not need to know that the device 
was selected from a stationary ensemble, but only that 
the observables derived from the device are consistent 
with, say, elementa of a hypothetically stationary en- 
semble. Notice also that the actual model used may 
depend upon how clever the experimenter-theorist is in 
generating models. 

It is worth noting, however, that while some texts 
on statistics give “tests for stationarity," these tests are 


the concept of stationarity. If a nonstationary model 
actually becomes common, it will almost surely be be- 
cause it is useful or convenient and not because the 
process is “actually nonstationary.” Indeed, the phrase 
“actually nonstationary” appears to have no 
in an operational sense. In short, stationarity (or 


Fortunately, many statistical models exist that =e 
quately describe most present-day signal 
many of these models are considered below. If is obviows 
that one cannot guarantee that all signal generators are 
adequately described by these models, but the authors 
do feel they are adequate for the description of most 
signal generators presently encountered. 


Il. Statement oF THE PROBLEM 


To be useful, a measure of frequency stability must 
allow one to predict performance of signal generators 
used in a wide variety of situations as well as allow 
one to make meaningful relative comparisons among 
signal generators. One must be able to predict perform- 
ance in devices that may most easily be described either 
in the time domain, or in the frequency domain, or in 
a combination of the two. This prediction of perform- 
ance may involve actual distribution functions, and thus 
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second moment measures (such as power spectra and 
variances} are not totally adequate. 

Two common types of equipment used to evaluate the 
performance of a frequency source are (analog) spectrum 
analyzers (frequency domain) and digital electronic 
counters (time domain). On occasion the digital counter 
data are converted to power spectra by computers. One 
must realize that any piece of equipment simultaneously 
has certain aspects most easily described in the time 
domain and other aspects most easily described in the 
frequency domain. For example, an electronic counter 
has 8 high-frequency limitation, an experimental spectra 
are determined with finite time averages. 

Research has established that ordinary oscillators dem- 
onstrate noise, which appears to be a superposition of 
causally generated signals and random nondeterministic 
noises. The random noises include thermal noise, shot 
noise, noises of undetermined origin (such as flicker 
noise), and integrals of these noises. 

One might well expect that for the more general cases 
one would need to use a nonstationary mode! (not sta- 
tionary even in the wide sense, i.e., the covariance sense), 
Nonstationarity would, however, introduce significant dif- 
ficulties in the passage between the frequency and time 
domains. It is interesting to note that, so far, experi- 
menters have seldom found a nonstationary (covariance) 
model useful in describing actual oscillators. 

In what follows, an attempt has been made to separate 
general statements that hold for any noise or perturba- 
tion from the statements that apply only to specific mod- 
els. It is important that these distinctions be kept in 
mind 


TIT, Backsrounp ano Dertnitions 


To discuss the concept of frequency stability imme- 
diately implies that frequency can change with time and 
thus one is not considering Fourier frequencies (at least 
at this point). The conventional definition of instantan- 
eous (angular) frequency is the time rate of change of 
phase; that is 


amy) = 28 ow ao a) 


where ®(t) is the instantaneous phase of the oscillator. 
This paper uses the convention that time-dependent 
frequencies of oscillators are denoted by »(t) (cycle fre- 
quency, hertz), and Fourier frequencies are denoted by 
» (angular frequency) or f (cycle frequency, hertz) where 
w = 2ef.In order for (1) to have meaning, the phase (t) 
must be well-defined function. This restriction imme- 
diately eliminates some “nonsinusoidal” signals such as 
@ pure random uncorrelated (“white”) noise. For most 
real signal generators, the concept of phase is reasonably 
amenable to an operational definition and this restric- 
tion is not serious. 

Of great importance to this paper is the concept of 
spectral density, S,(f). The notation S,(f) is to repre- 


Week tHeN eu th 


SasW attain wan pitt 
sent the one-sided spectral density of the (pure real 
function gif} on a per hertz basis; that 1 ie total 
“power” or mean-square value of git) is given by 


f SA df 


Since the spectral density is such an important con- 
cept to what follows, it is worthwhile to present some 
important references on spectrum estimation, There are 
many references on the estimation of spectra from data 
records, but worthy of special note are [2]-|5] 


TV, Derinition or Measures of Frequency Stasiuity 
(Seconp-Moment Tyre) 
A. General 


Consider a signal generator whose instantancous out- 
put voltage V(t) may be written as 


V(t) = [Vo + eft}] sin (2mvof + v(t)! (2) 


where Vy and », are the nominal amplitude and fre- 


quency, respectively, of the output and it is assumed 
that 
e(t) \ 
ka «1 iS) 
and 
wy (4) 
2m 


for substantially all time (- Making use of (1) and (2) 
one sees that 


OL) Qeel + oft) (5) 
and 


vit) =r + ro) (Wi) 
2s 

Equations (3) and (4) are essential in order that p(t) 

may be defined conveniently and unambiguously (vec 

measurement section) 

Since (4) must be valid even to speak of an instantan- 
eous frequency, there is no real need to distinguish 
stability measures from instability measures. That is 
any fractional frequency stability measure will be far 
from unity, and the chance of confusion is slight, It is 
true that in a very strict sense people usually measure 
instability and speak of stability, Because the chances of 
confusion are so slight, the authors have chosen to con- 
tinue in the custom of measuring “instability” and speak- 
ing of ility (a number always much less than unity) 

Of significant interest to many people is the radio fre- 
quency (RF) spectral density Sy(f). This is of direct 
concern in spectroscopy and radar, However, this is nof 
a good primary measure of frequency stability for two 
reasons. First, fluctuations in the amplitude e(t) contrib- 
ute directly to S;(fi; and second, for many cases when 
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c(t) is insignificant, the RF spectrum S,(f) is not 
uniquely related to the frequency fluctuations [6]. 


B. General: First Definition of the Measure of Frequency 
Stability—Frequency Domain 


By definition, let 
vy =, a) 


2am 

where y(t) and vo are as in (2), Thus y(t) is the in- 
stantaneous fractional frequency deviation from the nom- 
inal frequency vo. A proposed definition of frequency 
stability is the spectral density S,(f) of the instantaneous 
fractional frequency fluctuations y(t). The function S,(f) 
has the dimensions of Hz. 

One can show [7) that if S,(/) is the spectral density 
of the phase fluctuations, then 


sn = (L)'s.0 


- (Gyr S.A. 8) 


Thus s knowledge of the spectral density of the phase 
fluctuations S,(/) allows a knowledge of the spectral 
density of the frequency fluctuations S,(f), the first def- 
inition of frequency stability, Of course, S,(f) cannot 
be perfectly measured—this is the case for any physical 
quantity; useful estimates of S,(f) are, however, easily 
obtainable. 


C. General: Second Definition of the Measure of Fre- 
quency Stability—Time Domain 

The second definition is based on the sample variance of 
the fractional frequency fluctustions. In order to present 
this measure of frequency stability, define g, by the 
relation 


ip anit 
wat fl yoda Geta— ey 


Qrver y 


where (,,, = 4 + 7,k = 0,1,2,--: , T is the repetition 
interval for measurements of duration r, and & is arbitrary. 
Conventional frequency counters measure the number of 
cycles in a period +; that is, they measure »or(1 + 9). 
When + is 1 8 they count the number of »(1 + 9). 
The second measure of frequency stability, then, is 
defined in anslogy to the sample variance by the relation 


cut, ye Gt E(n-kEs)), am 


where (g) denotes the infinite time average of g. This 
measure of frequency stability is dimensionless. 

In many situations it would be wrong to assume that 
(10) converges to a meaningful limit as N — ©, First, 
of course, one cannot practically let N approsch infinity 
and, second, it is known that some actual noise processes 
contain substantial fractions of the total noise power in 


the Fourier frequency range below one cycle per year. 
In order to improve comparability of data, it is important 
to specify particular N and 7. For the preferred definition 
we recommend choosing N = 2 and T = rf (i.e., no dead 
time between measurements). Writing (0}(N =2, T=r, r)) 
as o}(r), the Allan variance [8], the proposed measure of 
frequency stability in the time domain may be written as 


os) = (dss =i" ay) 


for T = +. 

Of course, the experimental estimate of o?(r) must be 
obtained from finite samples of data, and one can never 
obtain perfect confidence in the estimate; the true time 
average is not realizable in a real situation. One estimates 
¢2(r) from a finite number (say, m) of values of o3(2, r, 7) 
and averages to obtain an estimate of o?(r). Appendix I 
shows that the ensemble average of ¢3(2, r, r) is convergent 
(i.e., a8 m — @) even for noise processes that do not have 
convergent (o3(N, r, r)) as N —+ ©. Therefore, o3(r) has 
greater utility as an idealization than does (¢3(@, r, 7)) 
even though both involve assumptions of infinite averages. 
In effect, increasing N causes o3(N, T, +) to become more 
sensitive to the low-frequency component of S,(f). In 
practice, one must distinguish between an st 
estimate of a quantity (say, of o}(r)) and its idealized 
value. It is reasonable to believe that extensions to the 
concept of statistical (“quality”) control [9] may prove 
useful here. One should, of course, specify the actual 
number m of independent samples used for an estimate 
of o%(r). 

In summary, therefore, S,(f) is the proposed measure of 
(instantaneous) frequency stability in the (Fourier) 
frequency domain and ¢}(r) is the proposed measure of 
frequency stability in the time domain. 

D. Distributions 

It is natural that people first become involved with 
second moment measures of statistical quantities and only 
later with actual distributions. This is certainly true with 
frequency stability. While one can specify the argument 
of a distribution function to be, say (1+: — gs), it makes 
sense to postpone such s specfication until a real use has 
materialized for a particular distribution function. This 
paper does not attempt to specify a preferred distribution 
function for frequency fluctustions. 


E. Treatment of Systematic Variations 

1) General: The definition of frequency stability ¢3(r) 
in the time domain is useful for many situations. However, 
some oscillators, for example, exhibit an aging or almost 
linear drift of frequency with time. For some applications, 
this trend may be calculated and should be removed [8] 
before estimating ¢}(r). 2 

In general, a systematic trend is perfeetly deterministic 
(ie, predictable) while the noise is nondeterministic. 
Consider a function g(t), which may be written in the form 
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gi) = ct) + nlf) (12) 


where c(t) is some deterministic function of time and n(t), 
the noise, is a nondeterministic function of time. We will 
define c(t) to be the systematic trend to the function g(t). 
A problem of significance here is to determine when and 
in what sense c(t) is measurable. 

2) Specific Case—Linear Drift: As an example, if we 
consider a typical quartz crystal oscillator whose fractional 
frequency deviation is y(t), we may let 


a) = Zy0 (a3) 


With these conditions, c(t) is the drift rate of the oscil- 
lator (e.g, 10°*/day) and n(t) is related to the fre- 
quency “noise” of the oscillator by a time derivative. 
One sees that the time average of g(t) becomes 


Fi Woden tef mode as) 


where c(t) = c, is assumed to be the constant drift rate 
of the oscillator. In order for c, to be an observable, 
it is natural to expect the average of the noise term to 
vanish, that is, converge to zero. 

It is instructive to assume [8], [10] that in addition 
to a linear drift, the oscillator is perturbed by a flicker 


noise, i.e. 
sy - ae O</Sh 
0, 1>h 
where h., is a constant (see Section V-A-2) and thus, 
8) = eae O</Sh 
0, {>t 


for the oscillator we are considering. With these assump- 
tions, it is seen that 


(15) 


(16) 


- 
tim +f" n(o at = (0) = 0 (17) 
j 


t= 


and that 


on {variance [i [m0 a} =o (18) 


where «(f) is the fourier transform of n(t). Since S,(0) 
= 0, «(0) must also vanish both in probability and in 
mean square. Thus, not only does n(t) average to zero, 
but one may obtain arbitrarily good confidence on the 
result by longer averages. 

Having shown that one can reliably estimate the drift 
tate c, of this (common) oscillator, it is instructive to 
attempt to fit a straight line to the frequency aging. 
That is, let 


0 = (19) 
and thus 


9) = co + alt — be) + 2") (20) 


ABER TRANSACTIONS ON INSTRUMENTATION (ND MEASUREMENT, May 1971 


where c is the frequency intercept at ¢ = ft, and ¢; is 
the drift rate previously determined. A problem anses 
here because 


SoG) = S,0) (21) 


tim {variance [i [wo a} == (2) 


for the noise model we have assumed. This follows from 
the fact that the (infinite V) variance of a flicker noise 
process is infinite [7], [8], [10]. Thus, co cannot be 
measured with any realistic precision, at least, in an 
absolute sense 

We may interpret these results as follows. After ex- 
perimenting with the oscillator for a period of time one 
can fit an empirical equation to y(t) of the form 


and 


yt) = oo + le, + n'(0), 


where n'(t) is nondeterministic. At some later time it is 
possible to reevaluate the coefficients co and c,. Accord- 
ing to what has been said, the drift rate c, should be 
reproducible to within the confidence estimates of the 
experiment regardless of when it is reevaluated. For cy, 
however, this is not true. In fact, the more one attempts 
to evaluate cy, the larger the fluctuations are in the 
result. 

Depending on the spectral density of the noise term 
it may be possible to predict future measurements of 
¢ and to place realistic confidence limits on the predic- 
tion [11]. For the case considered here, however, these 
confidence limits tend to infinity when the prediction 
interval is increased. Thus, in @ certain sense, cy i> 
“measurable” but it is not in statistical control (to use 
the language of the quality control engineer [9]) 


V. Transiations AMONG Frequency Stasitity 
‘MEASURES 


A. Frequency Domain to Time Domain 

1) General: It is of value to define r = T/r; that is, 
r is the ratio of the time interval between successive 
measurements to the duration of the averaging period 
Cutler has shown (see Appendix I) that 


(oi(N. 7. 7) * 
a * oe ap Isin’ (fr) {) _ sin? (erfNr) \. 
woah aso mate fy N¥ sin’ (er), 

(23) 


Equation (23) in principle allows one to calculate the 
time-domain stability (03(N, T, r)) from the frequency- 
domain stability S,(f). 

2) Specific-Model: A model that has been found use- 
ful [8], [10]-[13] consists of a set of five independent 
noise processes z,(t),n = —2, —1, 0,1, 2, such that 
* See Appendix Note # 19 
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Vt) = 2-2( + 2-110 + 20lt) + al) + alt) (24) 
and the spectral density of z, is given by 


s.) = . ESES 
0, 1>f.n = —2, -1,0,1,2, 
where the h, are constants. Thus, S,(/) becomes 


SA) = haf? + hil! + he + hf + haf’, (26) 


for 0 < f < f, and S,({) is assumed to be negligible beyond 
this range. In effect, each z, contributes to both S,(f) and 
(o3(N, T, r)) independently of the other z, The con- 
tributions of the z. to (#3(N, 7, r)) are tabulated in 
Appendix II. 

Any electronic device has a finite bandwidth and this 
certainly applies to frequency-measuring equipment also. 
For fractional frequency fluctuations y(¢) whose spectral 
density varies as 


SO~f, a2-1 (27) 


for the higher Fourier components, one sees (from 
Appendix I) that (¢}(N, 7, r)) may depend on the exact 
shape of the frequency cutoff. This is true because a 
substantial fraction of the noise ‘‘power'’ may be in these 
higher Fourier components. As a simplifying assumption, 
this paper assumes a sharp cutoff in noise “power” at the 
frequency /, for the noise models. It is apparent from the 
tables of Appendix II that the time domain measure of 
frequency stability may depend on f, in 8 very important 
way, and, in some practical cases, the actual shape of the 
frequency cutoff may be very important [7]. On the 
other hand, there are many practical measurements 
where the value of /, has little or no effect. Good practice, 
however, dictates that the system noise bandwidth {, 
should be specified with any results. 

In actual practice, the model of (24)-(26) seems to fit 
almost all real frequency sources. Typically, only two or 
three of the h-coefficients are actually significant for a 
real device and the others can be neglected. Because of 
its applicability, this model is used in much of what 
follows. Since the z, are assumed to be independent noises, 
it is normally sufficient to compute the effecta for a 
general z, and recognize that the superposition can be 
accomplished by simple additions for their contributions 
to S,(/) or (63(N, T, r)). 


(25) 


B. Time Domain to Frequency Domain 

1) General: For general (e3(N, T, r)) no simple pre- 
scription is available for translation into the frequency 
domain. For this reason, one might prefer S,(f) as a 
general measure of frequency stability. This is especially 
true for theoretical work. 

2) Specific Model: Equations (24)-(26) form a realistic 
model that fits the random nondeterministic noises found 
on most signal generators. Obviously, if this is a good 
model, then the tables in Appendix II may be used 
(in reverse) to translate into the frequency domain. 


ut 
Allan [8] and Vessot [12] showed that if 
S) = 4 O<I<h (23) 
0, 1>h 
where a is a constant, then 
((N, T,2))~ Ie", arf, > 1 (29) 


for N and r = T/r held constant. The constant » is 
related to a by the mapping shown’ in Fig. 1. If (28) 
and (29) hold over a reasonable range for a signal gen- 
erator, then (28) can be substituted into (23) and evaluated 
to determine the constant h, from measurements of 
(o3(N, T, r)). It should be noted that the model of (28) 
and (29) may be easily extended to a superposition of 
similar noises as in (26). 


C. Translations Among the Time-Domain Measures 

1) General: Since {o}(N, T, r)) is a function of N, T, 
and + (for some types of noise /, is also important), it is 
very desirable to be able to translate among different 
sets of N, T, and + (f, held constant), This is, however, 
not possible in general. 

2) Specific Model: It is useful to restrict consideration 
to a case described by (28) and (29). Superpositions of 
independent noises with different power-law types of 
spectral densities (i.e., different a) can also be treated by 
this technique, e.g., (26). One may define two “bias 
functions,” B, and B, by the relations [13] 


CAG T. 1)) 
* iQ. 7. 2) (> 


BAN, +, x») 


and 
(o3(2, T, 2) 
Biba) = ee a) en 


where r = T'/r and y is related to a by the mapping of 
Fig. 1. In words, B, is the ratio of the average variance 
for N samples to the average variance for two samples 
(everything else held constant), while B, is the ratio of 
the average variance with dead time between measure- 
ments (r 1) to that of no dead time (r = 1 and with 
N = 2and r held constant). These functions are tabulated 
in [13]. Figs. 2 and 3 show s computer plot of 
BAN,r = 1, ») and B,(r, u). 

Suppose one has an experimental estimate of (¢}(Ni, 
T,, 7,)) and its spectral type is known, i.e., (28) and (29) 
form a good model and u is known. Suppose also that one 
wishes to know the variance at some other set of measure- 
ment parameters Nj, Ts, ts. An unbiased estimate of 
(o3(Na, Ts, r2)) may be caleulated by 


+1t should be noted that in Allan = te the exponent @ cor- 
responds to the spectrum of fluctuations while variances 
are taken over average frequency fluctuations. In the present 
paper, @ is identical to the exponent a + 2 in (8). 
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Fig. 1. « — @ mapping. 


Fig. 2. Function B(N, r = 1, ») 


4ol(N3. Tp, 11)) = (2) 


2 lu, Ti.r)). (82) 


where r; = T,/x; and ry = T2/r 

$) General: While it is true that the concept of the 
Dias functions B, and Bz could be extended to other 
processes besides those with the power-law types of 
spectral densities, this generalization has not been done. 
Indeed, spectra of the form given in (28) [or super- 
positions of such spectra as in (26)] seem to be the 
most common types of nondeterministic noises encoun- 
tered in signal generators and associated equipment. For 
other types of fluctuations (such as causally generated 
perturbations), translations must be handled on an in- 
dividual basis. 


VI. Apptications or Stapitity MEASURES 


Obviously, if one of the stability measures is exactly 
the important parameter in the use of a signal generator, 
the stability measure’s application is trivial. Some non- 
trivial applications arise when one is interested in a dif- 


WHR TRANSACTIONS ON INWTRUMENTVTINS ANH restr MEST IMD 


Fig. 3. Bias function By(r, ») 


ferent parameter, such as in the use of an oscillator in 
Doppler radar measurements or in clocks 


A. Doppler Radar 


1) General: From its transmitted signal. a Doppler 
radar receives from a moving target u [requency-shifted 
return signal in the presence of other large signals. These 
large signals can include clutter (ground return) and 
transmitter leakage into the receiver (spillover) In- 
stabilities of radar signals result in noise energy on the 
clutter return, on spillover, and on local oscillators in 
the equipment. 

The limitations of subclutter visibility (SCV) rejecs 
tions due to the radar signals themselves are related to 
the RF power spectral density Sf). The quantity typi- 
cally referred to js the carrier-to-noise ratio and can be 
mathematically approximated by the quantity 


_ Se) 
f So()af" 


The effects of coherence of target return and other 
radar parameters are amply considered in the literature 
[14]-[17]. 

2) Special Case: Because FM effects generally pre- 
dominate over AM effects, this carrier-to-noise ratio is 
approximately given by [6] 


SviD 
ff seanar 
i 
for many signal sources provided |f — wi is sufficiently 


greater than zero. (The factor of } arises from the fact 
that S,(f) is a one-sided spectrum.) Thus, if f — vy is 


TAS — vol), (33) 
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a frequeney separation from the carrier, the carrier-to- 
noise ratio at that point is approximately 


2 
at = 0d = FEY su = nd. 
B. Clock Errors 

1) General: A clock is a device that counts the cycles 


of a periodic phenomenon. Thus, the reading error z(t) 
of a clock run from the signal given by (2) is 


x) = ) 


(35) 


and the dimensions of r(t) are seconds. 

If this clock is a secondary standard, then one could 
have available some past history of z(t), the time error 
relative to the standard clock, It often oecurs that one 
is interested in predicting the clock error z(t) for some 
future date, say ts + +, where t is the present date. 
Obviously, thi & problem in pure prediction and can 
he handled by conventional methods [3] 

2) Special Case: Although one could handle the predic- 
tion of clock errors by the rigorous methods of prediction 
theory, it is more common to use simpler prediction 
methods {10}, [11]. In particular, one often predicts a clock 
error for the future by adding to the present error a 
correction that is derived from the current rate of gain 
(or loss) of time. That is, the predicted error Z(t + 1) 
is related to the past history of z(t) by 


By to) = x(t) + 7[s= a — 0), 


It is typical to let T = r. 
Thus, the mean-square error of prediction for T = + 
becomes 


({elto + 7) — #(lo + +)/?) 
= (alo + 7) = 2x(lo) + 2 -— }*), (37) 
which, with the aid of (11), can be written in the form 
(alts + 1) — Elle + rf?) = 2r7ei(r). (38) 


One can define a time stability measure o3(r) by 
ei(r) = rei(r). (39) 


Clearly, however, the actual errors of prediction of clock 
readings are dependent on the prediction algorithm used 
and the utility of such a definition as ¢2(r) is not great. 
Caution should be used in employing this definition. 


VIL Measurement Tecuniqves ror Frequency 
StapiLity 


A. Heterodyne Techniques (General) 


It is possible for oscillators to be very stable and 
values of ey(r) can he as small as 10-* in some state-of- 
the-art equipment. Thus, one often needs measuring tech- 
iques capable of resolving very small fluctuations in 


© See Appendix Note # 20 


ins 


y(t). One of the most common techniques is a heterodyne 
or beat frequency technique. In this method, the signal 
from the oscillator to be tested is mixed with a reference 
signal of almost the same frequency as the test oscillator 
in order that one is left with a lower average frequency 
for analysis without reducing the frequency (or phase) 
fluctuations themselves. Following Vessot et al. [18], 
consider an ideal reference oscillator whose output signal 
is 


Vi) = Vor sin 2arvet (40) 


and a second oscillator whose output voltage V(é) is 
given by (2): V) = [Vo + e(t)] sin [2nvct + (OJ. Let 
these two signals be mixed in a product detector; that is, 
the output of the product detector v(t) is equal to the 
product yV(‘) X V,(0), where y is a constant (see Fig. 4). 

Let v(t), in turn, be processed by a sharp low-pass filter 
with cutoff frequency f{ such that 


O<h << m 1 
One may write 
WV VA) 
= 7V..(V_ + oisin 2xvof](sin (2x%0f + ¥)) 
eu)ey (Wae¥a) (1 + £)ieos — cos (4xvof + ¢)). 
2 ° 


(42) 


Assume that cos [y(t)] has essentially no power in Fourier 
frequencies / in the region { > f{. The effect of the low-pass 


(36) & filter then is to remove the second term on the extreme 


right of (42); that is 
vy = eet (1 + +) cos #(t). (43) 


This separation of terms by the filter is correct only if 
\[e()/2v9}| < 1 for all ¢ (4). 
The following two cases are of interest. 
Case I: The relative phase of the oscillators is ad- 
justed so that |p(t)| « 1 (in-phase condition) during 
the period of measurement. Under these conditions 


v'() © 5 VorVe + F Vovtlt). (44) 


since cos »(t) = 1. That is to say one detects the ampli- 
tude noise «(¢) of the signal. 

Case II; The relative phase of the oscillators is ad- 
justed to be in approximate quadrature; that is 


e) = 0 +5 (43) 
where 'y’it)' & 1. Under these conditions, 


cos y(t) = sin o{t) > o'() (46) 
and 


CD = ZV Vw'O +3 Vowel. aN) 
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Fig. 4. Heterodyne scheme. 


If it is true that |[e(t)/Vo]] « 1 for all ¢ (3), then 
(47) becomes 


10 ~EVenVor'(Di 48) 


that is, v(t) is proportional to the phase fluctuations, 
‘Thus, in order to observe »’(t) by this method, (3) and 
(4) must be valid. For different average phase values, 
mixtures of amplitude and phase noise are observed. 

In order to maintain the two signals in quadrature for 
long observational periods, the reference oscillator can 
be a voltage-controlled oscillator (VCO) and one may 
feed back the phase error voltage as defined in (48) to 
control the frequency of the VCO [19]. In this condition 
of the phase-locked oscillator, the voltage v’(t) is the 
anslog of the phase fluctuations for Fourier frequencies 
above the loop cutoff frequency of the locked loop. For 
Fourier frequencies below the loop cutoff frequency of 
the loop, v’(t) is the anslog of frequency fluctuations. 
In practice, one should measure the complete servo-loop 
Tesponse. 


B. Period Measurement 


Assume one has an oscillator whose voltage output 
may be represented by (2). If |[e(t)/Vo]| “ 1 for all 
@ and the total phase 


0) = Aart + f(t) (5) 

is a monotonic function of time (that is, |[¢(t)/2r7]| < 1), 

then the time { between successive positive going sero 

crossings of V (‘) is related to the average frequency during 
the interval r. 

Pani +90. (49) 


If one lets + be the time between a positive going zero 
crossing of V(t) and the Mth successive positive going 
sero crossing, then 


Mao +9). (60) 


If the variations Ar of the period are small compared to 
the average period r,, Cutler and Searle [7] have shown 
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that one may make @ reasonable approximation to 
(@3(N, T, r9)) using period measurements. 


C. Period Measurement With Heterodyning 
Suppose that p(t) is a monotonic function of time. 
The output of the filter of Section VII-A (43) becomes 


iA 


o() sy Es cos p(t) (51) 
if |[e(t)/Vo]| & 1. Then one may measure the period 
+ of two successive positive zero crossings of v’(¢). Thus 


1 
7 =v Ida (52) 
and for the Mth positive crossover 


Man io. (53) 


The magnitude bars appear because cos y(t) is an even 
function of »(¢). It is impossible to determine by this 
method alone whether ¢ is increasing with time or de- 
creasing with time. Since y. may be very small (~10-"* 
or 10 for very good oscillators), r may be quite long 
and thus measurable with a good relative precision. 

If the phase »(t) is not monotonic, the true j, may be 
near sero but one could still have many zeros of cos ¢(t) 
and thus (52) and (53) would not be valid. 


D. Frequency Counters 

Assume the phase (either or ¢) is 8 montonic func- 
tion of time. If one counts the number M of positive going 
sero croseings in a period of time r, then the average fre- 
quency of the signal is M/r. If we assume that the signal 
is V(t) a8 defined in (2), then 


Mn + H0- (64) 


If we assume that the signal is v'(¢) as defined in (48), 
then 


Mo to. (85) 
Again, one measures only positive frequencies. 


E. Frequency Discriminatore 
A frequency discriminator is a device that converts 
frequency fluctuations into an analog voltage by means 
of a dispersive element. For example, by slightly detuning 
& resonant circuit from the signal V(t) the frequency 
fluctuations (1/2x)]p(t) are converted to amplitude fluc- 
tuations of the output signal. Provided the input amplitude 
fluctuations [¢(t)]/V. are insignificant, the output ampli- 
tude fluctuations can be a good measure of the frequency 
fluctuations. Obviously, more sophisticated frequency 
discriminators exist (e.g., the cesium beam). 
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From the analog voltage one may use anslog spectrum 
analyzers to determine S,(f), the frequency stability. By 
converting to digital data, other analyses are possible 
on @ computer. 


F. Common Hazards 

1) Errors Caused by Signal-Processing Equipment: The 
intent of most frequency stability measurements is to 
evaluate the source and not the measuring equipment. 
Thus, one must know the performance of the measuring 
system. Of obvious importance are such aspects of the 
measuring equipment as noise level, dynamic range, 
resolution (dead time), and frequency range. 

It has been pointed out that the noise bandwidth /, is 
very essential for the mathematical convergence of certain 
expressions. Insofar as one wants to measure the signal 
@ource, one must know that the measuring system is not 
limiting the frequency response. At the very least, one 
must recognize that the frequency limit of the measuring 
system may be a very important, implicit parameter for 
either o}(é) or S,(f). Indeed, one must account for any 
deviations of the measuring system form ideality such as 
 “nonflat’”’ frequency response of the spectrum analyzer 
iteelf. 

Almost any electronic circuit that processes a signal 
will, to some extent, convert amplitude fluctuations at the 
input terminals into phase fluctuations at the output. 
Thus, AM noise at the input will cause a time-varying 
phase (or FM noise) at the output. This can impose im- 
portant constraints on limiters and automatic gain control 
(AGC) circuits when good frequency stability is needed. 
Similarly, this imposes constraints on equipment used for 
frequency stability measurements. 

2) Analog Spectrum Analyzers (Frequency Domain): 
Typical analog spectrum analyzers are very similar in 
design to radio receivers of the superheterodyne type, and 
thus certain design features are quite similar. For exam- 
ple, image rejection (related to predetection bandwidth) 
is very important. Similarly, the actual shape of the 
analyzer’s frequency window is important since this af- 
fecta spectral resolution. As with receivers, dynamic 
range can be critical for the analysis of weak signals in 
the presence of substantial power in relatively narrow 
bandwidths (e.g., 60 Hs). 

The slewing rate of the analyzer must be consistent 
with the analyzer’s frequency window and the post-detec- 
tion bandwidth. If one has a frequency window of 1 Hz, 
one cannot reliably estimate the intensity of a bright 
line unless the slewing rate is much slower than 1 Hz/s. 
Additional post-detection filtering will further reduce the 
maximum usable slewing rate. 

3) Spectral Density Estimation from Time Domain 
Data: It is beyond the scope of this paper to present a 
comprehensive list of hazards for spectral density estima- 
tion; one should consult the literature (2]-[5]. There 


us 


sre a few points, however, which are worthy of special 
notice: a) data aliasing (similar to predetection band- 
width problems); b) spectral resolution; and ¢) con- 
fidence of the estimate. 

4) Variances of Frequency Fluctuations o3(r): It is not 
uncommon to have discrete frequency modulation of a 
source such as that associated with the power supply 
frequencies. The existence of discrete frequencies in S,(f) 
can cause o}(r) to be a very rapidly changing function 
of r. An interesting situation results when r is an exact 
multiple of the period of the modulation frequency (e.g., 
one makes r = 1s and there exists 60-Hz frequency 
modulation on the signal). In this situation, o}(r = 1 8) 
can be very optimistic relative to values with slightly 
different values of r. 

One also must be concerned with the convergence 
Properties of o3(r) since not all noise processes will have 
finite limits to the estimates of o3(r) (see Appendix I), 
One must be as critically aware of any ‘‘dead time” in the 
measurement process as of the system bandwidth. 

6) Signal Source and Loading: In measuring frequency 
stability one should specify the exact location in the 
circuit from which the signal is obtained and the nature 
of the load used. It is obvious that the transfer character- 
istics of the device being specified will depend on the load 
and that the measured frequency stability might be 
affected. If the load itself is not constant during the 
measurements, one expects large effects on frequency 
stability. 

6) Confidence of the Estimate: As with any measurement 
in science, one wants to know the confidence to assign to 
numerical results. Thus, when one measures S,(f) or ¢3(r), 
it is important to know the accuracies of these estimates. 

a) The Allan Variance: It is spparent that a single 
sample variance o}(4, r, r) does not have good confidence, 
but, by averaging many independent samples, one can 
improve the accuracy of the estimate greatly. There is a 
key point in this statement, ‘independent samples.” For 
this argument to be true, it is important that one sample 
variance be independent of the next. Since (2, r, r) is 
related to the first difference of the frequency (11), 
it is sufficient that the noise perturbing y(t) have “inde- 
pendent increments,” i.e., that y({) be a random walk. 
In other words, it is sufficient that S,(f) ~ f”* for low 
frequencies. One can show that for noise processes that 
are more divergent at low frequencies than f~*, it is 
difficult (or impossible) to gain good confidence on 
estimates of o3(r). For noise processes that are less 
divergent than f~*, no problem exists. 

It is worth noting that if we were interested in 
o(N = ©, +, 7), then the limit noise would become 

S,() ~ f instead of f~* as it is for o3(2, r, r). Since most 
= signal generators possess low-frequency divergent 
(2, 7, r)) is more useful than o}(N = @, , 1). 

wr Altbotgh the suzuple’ varisnesn @C, % #) will not be 
normally distributed, the variance of the average of m 
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independent (nonoverlapping) samples of o1(2, +, r) 
(ie., the variance of the Allan variance) will decrease as 
1/m provided the conditions on low-frequency divergence 
are met. For sufficiently large m, the distribution of the 
m sample averages of o,(2, r, r) will tend toward normal 
(central limit theorem). It is thus possible to estimate 
confidence intervals based on the normal distribution. 

As always, one may be interested in + values approach- 
ing the limits of available data. Clearly, when one is 
interested in r values of the order of a year, one is severely 
limited in the size of m, the number of samples of o3(2, r, r). 
Unfortunately, there seems to be no substitute for many 
samples and one extends r st the expense of confidence in 
the results. “Truth in packaging” dictates that the sample 
aise m be stated with the resulta. 

b) Spectral Density: As before, one is referred to the 
literature for discussions of spectrum estimation [2}-[5]. 
It is worth pointing out, however, that for S,(/) there are 
basically two different types of averaging that can be 
employed: sample averaging of independent estimates 
of S,(f), and frequency averaging where the resolution 
bandwidth is made much greater than the reciprocal data 
length. 


VIII. Coxciusions 

A good measure of frequency stability is the spectral 
density 5S,(f) of fractional frequency fluctuations y(¢). 
An alternative is the expected variance of N sample 
averages of y(t) taken over s duration r. With the begin- 
ning of succeasive sample periods spaced every T units 
of time, the variance is denoted by o3(N, 7, 1). The 
stability measure, then, is the expected value of many 
measurements of o}(N, T, r) with N = 2 and T = +; 
that is, o%(r). For all real experiments one has a finite 
bandwidth. In general, the time domain measure of 
frequency stability o3(r) is dependent on the noise band- 
width of the system. Thus, there are four important 
parameters to the time domain measure of frequency 


N Number of sample averages (NV = 2 for preferred 
measure). 

T Repetition time for successive sample averages 
(T = + for preferred measure). 

+ Duration of each sample average. 

fx System noise bandwidth. 


Translations among the various stability measures for 
common noise types are possible, but there are significant 
reasons for choosing N = 2 and T = r+ for the preferred 
measure of frequency stability in the time domain. This 
measure, the Allan variance, (N = 2) has been referenced 
by [12], [20}-{22] and more. 

Although S,(f) appears to be a function of the single 
variable f, actual experimental estimation procedures 
for the spectral density involve a great many parameters. 
Indeed, its experimental estimation can be at least as 
involved as the estimation of o3(r). 


Heee THAN 


SON INSTRUMENTATION OND MECEEREME NT Oy 
Apresorx T 
We want to derive (23) in the text. Starting from (10) 
we have 


(@(N, 7, +)) 


pase te 
fe “ae at’ werner} (56) 
where (9) has been used. Now 


WOve)) = Re = 0) (57) 


where R,(r) is the autocorrelation function of y(t) and 
is the Fourier transform of S,(f), the power spectral 
density of y(t). Equation (57) is true provided that 
y(t) is stationary (at least in the wide or covariance 
sense), and that the average exists. If we assume the 
power spectral density of y(t), S,(f) has low and high 
frequency cutoffs f; and /, (if necessary) so that 


[soa 


exists, then if y is a random variable, the average does 
exist and we may safely assume stationarity. 

In practice, the high-frequency cutoff f, is always 
present either in the device being measured or in the 
measuring equipment itself. When the high-frequency 
cutoff is necessary for convergence of integrals of S,(/) 
(or is too low in frequency), the stability measure will 
depend on fy, The latter case can occur when the measur- 
ing equipment is too narrow-band. In fact, a useful 
type of spectral analysis may be done by varying fy 
purposefully [18]. 

The low-frequency cutoff f, may be taken to be much 
smaller than the reciprocal of the longest time of inter- 
est. The results of calculations as well as measurements 
will be meaningful if they are independent of f, as f; 
approaches zero. The range of exponents in power law 
spectral densities for which this is true will be discussed 
and are given in Fig, 1. 

To continue, the derivation requires the Fourier trans- 
form relationships between the autocorrelation function 
and the power spectral density 


8) = 4 [Rel coe 2afr dr 


Ryo) = [8 cos 2x} df. a 


Using (58) and (57) in (56) gives 
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atl [aso [a 


[ae con ae 9 - FZ EEL as 


foe fo ee en} 
él ase 


“Wee ls (rf) 


-4355 Uf a SL, (2 cos 2efT — 0 


(oi(N.T, 1) = 


= cos 2xf{7'j — 1) + +) — cos 2ef[TG — ) — ~}}. 

(59) 

(The interchanges in order of integration are permissible 

here since the integrals are uniformly convergent with 

the given restrictions on S,(f).) The first summation in 

the curly brackets is independent of the summation in- 
dex n and thus gives just 


“a sin’ afr 

vf asp ae. (60) 
The kernel in the second term in the curly brackets 

may be further simplified 

2 cos 2xf7(j — 1) — cos 2xf(T(j — 1) + 1) 


= cos 2xf(T(j — i) — 1) = Asin’ #fr cos 2e/T(j — 1). 
(61) 


The second term is then 


= El at SQ sin ate EE coe 105 - 0). 2 


(The interchange of summation and integration is justi- 
fied.) We must now do the double sum. Let 


jr-iak 
QefT = x. (63) 


Changing summation indices from i and j to ¢ and k 
gives for the sum 


S= XE cosh - 


The region of summation over the discrete variables i 
and k is shown in Fig. 5 for N = 4. 

The summand is independent of iso that one may inter- 
change the order of summation and sum over i first. 
The summand is even in k and the contributions for 
k < 0 are equal to those for k > 0, and so we may pull 
out the term for k = 0 separately and write 


8 = (E costz $1) + 51 


2 Ew — b costs) +. (65) 


MMe 


j= z X coskz. (64) 


ths 


Fig. 5. Region of summation for i and k for N = 4. 


This may be written as 


s=v+2Re[y-12]¥ (66) 


where Re{[U] means the real part of U and d/dr 
is the differential operator. The series is a simple geo- 
metric series and may be summed easily, giving 


s=v+2ne{[y-1e]emerh 


=v +oRefLae" = Nae} 


4sin® 2/2 


_ sin’ Nz/2_ 
sin’ 2/2 
Combining everything we get, after some rearrangement, 
(NT, r)) 


- wif sol - ee] 
where r = 1'/r. This is the result given in (28). 


We can determine a number of things very easily from 
this equation. First let us change variables. Let rjfr = u, 
then 


(67) 


(NT. 2) 
N ‘u \ sin’ “{ sin’ Nru }. 
-wil o(s) arf - yee 
(69) 
‘The kernel behaves like u* as u—+ 0 and like u* as u— =. 
Therefore (¢}(N, T, r)) is convergent for power law 
spectral densities, S,(f) = A,f*, without any low- or high- 
frequency cutoffs for —3 < a .< 1. Using (69) for power 
law spectral densities we find 
GN, T, 1) = he. 
= rhc. 


-3<a<l 


x mt omit fe 
C= [ duu af 


sin’ Nru \. 
(v= De" 


N? sin? ru. 
(70) 


This is the basis for the plot in Fig. 1 in the text of u 
versus a. For a > 1 we must include the high-frequency 
cutoff j,. 

For NV = 2 and r = 1 the results are particularly sim- 
ple. We have 


(e2(2, r,7)) = rth, fF duu sint (71) 


for power law spectral densities. For N = 
eral r we get 


2 and gen- 


(e(2, T, 7)) 


Sy ie u 
~ anf s(2) 
1—cos 2u— cos 2ru+ SOS 2UCtD) , 208 2ue— 1 
2 2 
= r 
w 


ug, #) sot want re 72) 


ard 


The first form in (72) is particularly simple and is also 
useful for r = 1 in place of (71). 

Let us discuss the case for « > 1 in a little more de- 
tail. As mentioned above we must include the high-fre- 
quency cutoff f, for convergence. The general behavior 
can be seen most easily from (68). After placing the 
factor +* outside the integral and combining the factor 
f* with S,(f) we find that the remaining part of the 
kernel consists of some constants and some oscillatory 
terms. If 2xfyr > 1 it is apparent that the rapidly oscil- 
lating terms contribute very little to the integral. Most 
of the contribution comes from the integral over the 
constant term causing the major portion of the + de- 
pendence to be the r-* factor outside the integral. This is 
the reason for the vertical slope at » = —2 in the 
» Versus a plot in Fig. 1 in the text. 

One other point deserves some mention. The constant 
term of the kernel discussed in the preceding paragraph 
is different for r = 1 from the value for r + 1. This is 
readily seen from (72) for N = 2; for r = 1 the constant 
term is 3/2 while for r * 1 it is 1, This is the reason 
for 8: (r — 1), which appears in some of the results of 
Appendix II. In practice, &(r — 1) does not have zero 
width but is smeared out over a width of approximately 
(2zf,r)-*. If there must be dead time r = 1, it is wise to 


* choose (r — 1) © (2ef,r)-* or (r — 1) K (2efar)? but 


with 2ef,r > 1. In the latter case, one may assume 
r=1. 
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Let yit) be # sample function of a random noise pro- 
cess with a spectral density S,(f). The function y:t) is 
assumed to be pure real and S,(f) is a one-sided spectrai 
density relative to a cycle frequency (i.e., the dimensions 
of S,(f) are that of y* per hertz). (For additional infor- 
mation see Appendix I, [7], [8], [18].) 

Let z(t) be defined by the equation 


2) = & = y(t). (73) 
Define the following. to is arbitrary instant of time and 
her BRET, n= 0120, (74) 


— A = z(t. 5 
net f ye at = 2 7 z(t.) 73) 


w= t) y ie, (76) 


and let f, be a high-frequency cutoff (infinitely sharp) 
with 2ef,r > 1. 


Definition: 
((N,T, 1) = Gry = @- y 

Special Case: 
((2, 7, #)) = (= a, (78) 


Special Case: 
oi(r) =m (o3(2, 7, 7) 


- (ee + 21) = 220 + 1) + 2(n) ‘). 79) 


Definition: 
Di(r) = ((zllo + 2r) — 2x(lo + 1) + (t)]"). (80) 
Consequence of Definitions: 
Di(r) = 2r*o(r) = 2ei(r). (81) 
Definition: 


VAT, +) = [zl + T + 1) — ree + T) 
— xl + 1) + 2(te)}"). (82) 


Consequence of Definitions: 
WUT, 1) = 2e°(05(2, T, 7)). (83) 
Special Case: 
Vir, 7) = Di(r). (84) 


eee LA 
Random Walk y 


Si) = (sun - 0) 
» OSfSh. 
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Quantity Relation 


uv.t.) hPa ya, ret 
(85) 
" 
(iN, 1, 1)) A Gert y, r=1 (86) 
dca 
Hr) a. Gort =2r=1 (87) 
Di{r) = 2 (88) 
Hu, ») hy OEE 
isp 1. (39) 
Flicker y 
5 hoy 
sy = 
r=T/r 
Quantity 
GAW.T od) hag 


+{=2(nr}? In (nr) + (nr + 1)? In (nr +) 


+ (nr — 1)" In nr — 1] (90) 
GW.) hy XB Gey @n 
a(t) hav2 In 2, (N = 2.7 = 1) (92) 
Dir) = Bole) Ao 4r? In 2 (93) 
WAT. 1) hie l—2F Ine + (r+ 1)? In + 1) 
+(r— 1 lnfp—1\) (94) 
whi 224+ Ind, rl 
~h-2T(2—Inr), rK&1. (5)* 
White y (Random Walk z) 
S=h 8.) = tt 
r=T/r, OSfSh. 
Quantity Relation 
wunet. ny Mele, or Dd 
horde(N + 1) [ris Nr Sd (96) 
iv, ry) rel @7) 
or) slr. N=2ret (98) 


(99) 


nus 
WAT, +) ho- |r|. r2>1 
he?, $1 (100) 
Flicker 
h 
8.) = hs tts. = a) 
r=T/r, whe Dl, ATI, OS FS he 
Quantity Relation 
WT.) ge 2 {2 + In (2ef,2) 
+NWoD para —n) 
$3 
in [3 ]} r>>1 (101) e & 
. YN +1) inv 
GUN. rE [2 + In (2efer) — pS). 
r=1 (102K 
or) hy Toy {are + In (2xf.x)] — In 2. 
N=2r=1 (103)#* 


Di(r) = 2ei{r) ar aie + In (2ef.7)] — In 2} (104)  & 


VT. 2) hy a 2+ InQehe}. rd 
oS {ate + tm rh) — in}, 
r= 1 (105)k% 
Ae ead (2+ In(2ef.7)]. r«l. 
White z 
. , n 
sin=ne (sh = Bh) 
r=T/r; 3(r — 1) = { Heel 
0, otherwise 
Qefyr > 1, O</sh.- 
Quantity Relation 
CHY,T. 1) hy MEE D2 (106) 
(X(N. 4, 9)) hs eae ns | (107) 
aX(r) diye ain. Ne=2r<1 (108) 
DiGs) = 26260) he GB (109) 
vuT. *) he-[2 + Br — 0) gos (110) 
‘#8 See Appendix Note # 22 
®8 See Appendix Note # 22 TN-160 
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CHARACTERIZATION OF FREQUENCY AND PHASE NOISE * 


(Study Programme 3B/7) 
(1974-1978-1986) 


L Introduction 


Techniques to characterize and to measure the frequency and phase instabilities in frequency generators 
and received radio signals are of fundamental importance to users of frequency and time standards, 


In 1964 a subcommittee on frequency stability was formed, within the Institute of Electrical and Electronic 
Engineers (IEEE) Standards Committee 14 and later (in 1966) in the Technical Committee on Frequency and 
Time within the Society of Instrumentation and Measurement (SIM), to prepare an IEEE standard on frequency 
stability. In 1969, this subcommittee completed a document proposing definitions for measures on frequency and 
phase stabilities. These recommended measures of stabilities in frequency generators have gained general 
acceptance among frequency and time users throughout the world. Some of the major manufacturers now specify 
stability characteristics of their standards in terms of these recommended measures. 


Models of the instabilities may include both stationary and non-stationary random processes as well as 
systematic processes. Concerning the apparently random processes, considerable progress has been made 
[IEEE-NASA, 1964; IEEE, 1972] in characterizing these processes with reasonable statistical models. In contrast, 
the presence of systematic changes of frequencies such as drifts should not bg modelled statistically, but should be 
described in some reasonable analytic way as measured with respect to an adequate reference standard, e.g, linear 
regression to determine a model for linear frequency drift. The separation between systematic and random parts 
however is not always easy or obvious. The systematic effects generally become predominant in the long term, and 
thus it is extremely important to specify them in order to giye a full characterization of a signal's stability. This 
Report presents some methods of characterizing the random processes and some important types of systematic 
Processes. 


Since then, additional significant work has been accomplished. For example, Baugh [1971] illustrated the 
properties of the Hadamard variance — a time-domain method of estimating discrete frequency modulation 
sidebands — particularly appropriate for Fourier frequencies less than about 10 Hz; a mathematical analysis of 
this technique has been made by Sauvage and Rutman [1973]; Rutman [1972] has suggested some alternative 
time-domain measures while still giving general support to the subcommittee’s recommendations; De Prins et al. 
{1969} and De Prins and Cornelissen, [1971] have proposed alternatives for the measure of frequency stability in 
the frequency domain with specific emphasis on sample averages of discrete spectra. A National Bureau of 
Standards Monograph devotes Chapter 8 to the “Statistics of time and frequency data analysis” (Blair, 1974]. This 
chapter contains some measurement methods, and applications of both frequency-domain and time-domain 
measures of frequency/phase instabilities. It also describes methods of conversion among various time-domain 
measures of frequency stability, as well as conversion relationships from frequency-domain measures to time- 
domain measures and vice versa. The effect of a finite number of measurements on the accuracy with which the 
two-sample variance is determined has been specified [Lesage and Audoin, 1973, 1974 and 1976; 
Yoshimura, 1978}. Box-Jenkins-type models have been applied for the interpretation of frequency stability 
measurements (Barnes, 1976; Percival, 1976] and reviewed by Winkler [1976]. 


Lindsey and Chie [1976] have generalized the r.m.s. fractional frequency deviation and the two-sample 
variance in the sense of providing a larger class of time-domain oscillator stability measures. They have developed 
measures which characterize the random time-domain phase stability and the frequency stability of an oscillator’s 
signal by the use of Kolmogorov structure functions. These measures are connected to the frequency-domain 
stability measure S,(f) via the Mellin transform. In this theory, polynominal type drifts are included and some 
theoretical convergence problems due to power-law type spectra are alleviated. They also show the close 
relationship of these measures to the r.m-s. fractional deviation (Cutler and Searle, 1966] and to the two-sample 
variance (Allan, 1966]. And finally, they show that other members from the set of stability measures developed are 
important in specifying performance and writing system specifications for applications such as radar, communica- 
tions, and tracking system engineering work. 


Other forms of limited sample variances have been discussed (Baugh, 1971; Lesage and Audoin, 1975; 
Boileau and Picinbono, 1976] and a review of the classical and new approaches has been published 
{Rutman, 1978}. ; 


% See Appendix Note # 23 TN-162 
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Frequency and phase instabilities may be characterized by random processes that can be represented 
statistically in either the Fourier frequency domain or in the time domain (Blackman and Tukey, 1959). The 
instantaneous, normalized frequency departure y(1) from the nominal frequency vo is related to the instantaneous- 
phase fluctuation @(1) about the nominal phase 2nvof by: 


ot. wt). oO 
au 2mvo dt 2nvo 4 
£0) 
mO= 5 - 


where x(1) is the phase variation expressed in units of time. 


2. Fourier frequency domain 


In the Fourier frequency domain, frequency stability may be defined by several one-sided (the Fourier 
frequency ranges from 0 to «) spectral densities such as: 


SAD) of ¥1), SoD) of (9, SoA) of 1), Ss) Of x(1, ete. 


These spectral densities are related by the equations: 


sin- £5 @) 
vo 

SD = 42 SN) (3) 
1 

SAD = Gaver SN (4) 


Power-law spectral densities are often employed as reasonable models of the random tiuctuations in 
Precision oscillators. In prac , it has been recognized that these random fluctuations are the sum of five 
independent noise processes and hente: 


: Piast for 0<s<h 
Sf) = for? (5) 
° for J >f, 
where /,'s are constants, a's are integers, and /, is the high frequency cut-off of a low pass filter. Equations (2), 
(3) and (4) are correct and consistent for stationary noises including phase noise. High frequency divergence is 
eliminated by the restrictions on f in equation (5). The identification and characterization of the five noise 


Processes are given in Table 1, and shown in Fig. |. In practice, only two or three noise processes are sufficient to 
describe the random frequency fluctuations in a specific oscillator; the others may be neglected. 


3. Time-domain 


Random frequency instability in the time-domain may be defined by several sample variances. The 
recommended measure is the two-sample standard deviation which is the square root of the two-sample zero 
dead-time variance o,?(t) [von Neumann ef al, 1941; Allan, 1966; Barnes ef al., 1971] defined as: 


2 
oy? (t) = (Hs Kh) (6) 
where 1 pete . o 
Keay | y(t)dr = a and 4% 4)=% + (adjacent samples) 
4 
<> denotes an infinite time average. The x, and x,,, are time residual measurements made at 4 and 
fai = fy + 1, k= 0, 1, 2,..., and 1/2 is the fixed sampling rate which gives zero dead time between frequency 
measurements. By “residual” it is understood that the known systematic effects have been removed. 
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If the initial sampling rate is specified as 1/t», then it has been shown [Howe ef al, 1981] that in general 
one may obtain a more el nt estimate of o,(t) using what is called “overlapping estimates”. This estimate is 
obtained by computing equation (7). 


t N=Im 


ZL Gisam — Wien + HP m 


2 —— 
O°" Tyo ame & 


where N is the number of original time departure measurements spaced by to, (N= M + 1, where M is the 
number of original frequency measurements of sample time, t9) and t = mto. The corresponding confidence 
intervals [Howe ef al., 1981], discussed in § 6, are smaller than those obtained by using equation (12), and the 
estimate is still unbiased. 


If dead time exists between the frequency departure measurements and this is ignored in computing 
equation (6), it has been shown that the resulting stability values (which are no longer the Allan variances), will be 
biased (except for the white frequency noise) as the frequency measurements are regrouped to estimate the stability 
for mto (m> 1). This bias has been studied and some tables for its correction published (Barnes, 1969; 
Lesage, 1983} 


A plot of o,(t) versus t for a frequency standard typically shows a behaviour consisting of elements as 
shown in Fig. 1. The first part, with o,(t) ~ «7!? (white frequency noise) and/or o,(t) ~ t~' (white or flicker 
phase noise) reflects the fundamental noise properties of the standard. In the case where o,(t) ~ t7', it is not 
practical to decide whether the oscillator is perturbed by white phase noise or by flicker phase noise. Alternative 
techniques are suggested below. This is a limitation of the usefulness of o,(t) when one wishes to study the nature 
of the existing noise sources in the oscillator. A frequency-domain analysis is typically more adequate for Fourier 
frequencies greater than about ! Hz. This t~' and/or t~'? law continues with increasing averaging time until the 
so-called flicker “floor” is reached, where o,(t) is independent of the averaging time t. This behaviour is found in 
almost all frequency standards: it depends on the particular frequency standard and is not fully understood in its 
physical basis, Examples of probable causes for the flicker “floor” are power supply voltage fluctuations, magnetic 
field fluctuations, changes in components of the standard, and microwave power changes. Finally the curve shows 
a deterioration of the stability with increasing averaging time. This occurs typically at times ranging from hours to 
days, depending on the particular kind of standard, 


A “modified Allan variance", MOD o3(t), has been ‘developed [Allan and Barnes, 1981] which has the 
property of yielding different dependences on t for white phase noise and flicker phase noise. The dependences 
for MOD a,(t) are t~”? and t! respectively. The relationships between o,(t) and MOD a,(t) are also explained 
in (Allan and Barnes, 1981; IEEE 1983, Lesage and Ayi, 1984) MODa,(t) is estimated using the following 
equation: 


Nodmel pmesnd 


 —— Fr 
MODE) = my E | E tae tent wif ® 


where N is the original number of time measurements spaced by to, and t = mty the sample time of choice. 
Properties and confidence of the estimate are discussed in Lesage and Ayi [1984]. Jones and Tryon [1983} and 
Barnes et al. [1982] have developed maximum likelihood methods of estimating o,(t) for the specific models of 
white frequency noise and random walk frequency noise, which has been shown to be a good model for 
observation times longer than a few seconds for caesium beam standards. 


4, Conversion between frequency and time domains 


In general, if the spectral density of the normalized frequency fluctuations S,(/) is known, the two-sample 
variance can be computed [Barnes ef al., 1971; Rutman, 1972]: ‘ 


ts sintatf 
a,2(2) = 2 ( 5) EY as ) 
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Sampling ume 


FIGURE 1 - Slope charactenstics of the five independent noise processes 
(log scale) 


Specifically, for the power law model given by equation (5), the time-domain measure also follows the 
power law as derived by Cutler from equations (5) and (9). 


(QnP a 1.038 + 3 log. (2nf, 1) hy 0 
oF (t) = hey ; FH hartge + the thors (10) 


Note. — The factor 1.038 in the fourth term of equation (10) is different from the value given in most previous 
publications. 
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The values of A, are characteristics of oscillator frequency noise. One may note for integer values (as often 
seems to be the case) that p = —a — I, for —-3 S$ a S$ 1, and p=—2 fora 2 1 where o}(t) ~ t* 


These conversions have been verified experimentally [Brandenberger ef al. 1971] and by computation 
{Chi, 1977]. Table II gives the coefficients of the translation among the frequency stability measures from time 
domain to frequency domain and from frequency domain to time domain. 


The slope characteristics of the five independent noise processes are plotted in the frequency and time 
domains in Fig. 1 (log log scale). 


s. Measurement techniques 


The spectral density of phase fluctuations S,(/) may be approximately measured using a phase-locked 
loop and a low frequency wave analyzer (Meyer, 1970; Walls es a/., 1976]. A double-balanced mixer is used as the 
phase detector in a lightly coupled phase lock loop. The measuring system uses available state-of-the-art electronic 
components; also a very high quality oscillator is used as the reference. For very low Fourier frequencies (well 
below 1 Hz), digital techniques have been used [Atkinson er al, 1963; De Prins et al, 1969; Babitch and 
Oliverio, 1974}. New methods of measuring time (phase) and frequency stabilities have been introduced with 
picosecond time precision [Allan and Daams, 1975}, and of measuring the Fourier frequencies of phase noise with 
30 dB more sensitivity than the previous state of the art (Walls ef al, 1976}. 


Several measurement systems using frequency counters have been used to determine time-domain stability 
with or without measurement dead time (Allan, 1974; Allan and Daams, 1975} A system without any counter has 
- also been developed (Rutman, 1974; Rutman and Sauvage, 1974]. Frequency measurements without dead time can 
be made by sampling time intervals instead of measuring frequency directly. Problems encountered when dead 
lime exists between adjacent frequency measurements have also been discussed and solutions recommended 
{Blair, 1974; Allan and Daams, 1975; Ricci and Peregrino, 1976}. Discrete spectra have been measured by 
Groslambert ef al. (1974). 


6. Confidence limits of time domain measurements 


A method of data acquisition is to measure time variations x, at intervals to. Then o,(t) can be estimated 
for any t = mt (mis any positive integer) since one may use those x, values for which j is equal to mk An 
estimate for o,(t) can be made from a data set with M measurements of J, as follows: 


i! 22 
4, (mg) = 8, la YS) % ,-9) | ay 
= at 
or equivalent 
Mn~t 
1 2] Y2 
* a raat Dy) Gye 2 Pao ty | (12) 
i= 


‘Thus, one can ascertain the dependence of o,(t) as a function of t from a single data set in a very simple way. 
For a given data set, M of course decreases as n increases, 


To estimate the confidence interval or error bar for a Gaussian type of noise of a particular value o,(t) 
obtained from a finite number of samples [Lesage and Audoin, 1973] have shown that: 


Confidence Interval J, = o,(t)- Ka - M-'? for M > 10 (13) 


where: 
M: total number of data points used in the estimate, 
a: as defined in the previous section, 
kK; = kK) = 0.99, 
Ko = 0,87, 
«_, = 0.77, 
KL, = 0.75. 
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As an example of the Gaussian model with M = 100, a = 1 (flicker frequency noise) and 
o,(t = 1 second) = 10-'?, one may write: 


ky = 6,(1)* Kas Mo"? = (1) - (0.77) + (100)-"? = a(t) - (0.077), (14) 
which gives: 
G,(t = 1 second) = (1 + 0.08) x 10-? (15) 


A modified estimation procedure including dead-time between pairs of measurements has also been 
developed (Yoshimura, 1978}, showing the influence of frequency fluctuations auto-correlation. 


7. ‘Conclusion 

The statistical methods for describing frequency and phase instability and the corresponding power law 
spectral density model described are sufficient for describing oscillator instability on the short term. Equation (9) 
shows that the spectral density can be unambiguously transformed into the time-domain measure. The converse is 
not true in all cases but is true for the power law spectra often used to model precision oscillators. 

Non-random variations are not covered by the model described. These can be either periodic or 
monotonic. Periodic variations are to be analyzed by means of known methods of harmonic analysis. Monotonic 
variations are described by linear or higher order drift terms. 


TABLE | — The functional characteristics of five independent noise processes 
Sor frequency instability of oscillators 


Slope characteristics of log log plot 


Frequency-domaine 


Time-domaine 


Description of noise process 


SelM or SAN 


White frequency 


Flicker phase 


White phase 


SNe hse ot) ~ [th 
KNeoevwhe fievwhf G=aa-2 a(n ~ |r? 


1 2 1 
SN= Gait Lhe 
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TABLE II — Translation of frequency stability measures from spectral densities in 
frequency domain to variance in time domain and vice versa (for 2xf,t > I) 


Description of noise process 


Random walk frequency 4[r se + [e" oof 2 


Flocker frequency alss,n]e 
White frequency eles, ne 
Flicker phase pls! snr? 
White phase elss. nr? 


ae Dw 1038 + 3 tom 2nfit) 
6 an 
B= 2 log.2 E- th 
an? 
c=12 
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The roles which spectral density of fractions! frequency fluctuations, two-sample variance. and 
power spectra play in different paris of the electromagnetic spectrum are introduced. Their relationship 
is discussed. Data acquisition in the frequency and the time domain is considered, and examples 
are given throughout the spectrum. Recently proposed methods for the characterization of a single 
high-quality frequency source are briefly descnbed. Possible difficulties and limitations in the 


interpretation of measurement results are specified, 


mostly in the presence of a dead time between 


measurements. The link between past developments in the field, such as two-sample variance and 


spectral analysis from time domain measurement, 


emphasized. 
1, INTRODUCTION 


Progress in the characterization of time and 
frequency stability has been initiated owing to the 
work of the various authors of papers delivered 
at the IEEE-NASA Symposium on Short Term 
Frequency Stability [1964] and of articles published 
in a special issue of the Proceedings of the JEEE 
[1966]. Presently widespread definitions of fre- 
quency stability have been given by Barnes er al. 
[1971]. Many of the most important articles on 
the subject of time and frequency have been gath- 
ered in the NBS Monograph 140 [1974] . Since that 
time, many papers have been published which 
outline different aspects of the field. Owing to the 
extent of the subject, they will be only partly 
reviewed here. We will emphasize recently 
proposed principles of measurements and recent 
developments in the time domain characterization 
of frequency stability. The subject of time predic- 
tion and modeling as well as its use for estimation 
of the spectrum of frequency fluctuations [ Percival, 
1978] are beyond the scope of this paper. Recent 
reviews which outline several different aspects of 
the field of time and frequency characterization 
have been published [ Barnes, 1976; Winkler, 1976; 
Barnes, 1977; Rutman, 1978; Kartaschoff, 1978]. 


2. DEFINITIONS: MODEL OF FREQUENCY 
FLUCTUATIONS 


The instantaneous output voltage of a frequency 
generator can be written as 


Copyright © 1979 by the Amencas Geophysics! Union. 


¥ See Appendix Note # 23 321 


and recentiy introduced structure functions is 


v(t) = [Vy + OV (6)] cos (2nvot + @(t)] (ly 


where V,, and v, are constants which represent the 
nominal amplitude and frequency, respectively. 
AV (0) and 9(t) denote time-dependent voltage and 
phase variations. 

Fractional amplitude fluctuations are defined by 


e(t) = AV (t)/ Mo (2) 


A power spectral density of fractional amplitude 
fluctuations S,(f) can be introduced if amplitude 
fluctuations are random and stationary in the wide 
sense. Usually, for high-quality frequency sources, 
one has 

lent Q) 


and amplitude fluctuations are neglected. However, 
it is known that amplitude fluctuations can be 
converted into phase fluctuations in electronic cir- 
cuits used for frequency metrology [Barillet and 
Audoin, 1976; Bava et al., 1977a] and that they 
may perturb measurement of phase fluctuations 
(Brendel et al., 1977}. It is then likely that amplitude 
fluctuations will become the subject of more de- 
tailed analysis in the future. 

According to the conventional definition of in- 
stantaneous frequency we have 


v(t) = vo + (1/2) @(t) (4) 
In a stable frequency generator the condition 
le (t)|/ 2m 1 (5) 


is generally satisfied. 
We will use the following notations (Barnes et 
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al., 1971]: 


Uj G 
2 od y(n = 22 © 
25% 2ay, 


x(t) = 


where x(t) and y(t) are the fractional phase and 
frequency fluctuations, respectively. The quantity 
x(t) represents the fluctuation in the time defined 
by the generator considered as a clock. 

At first, we will make the following assumptions: 

1. The quantities x(t) and y(t) are random func- 
tions of time with zero mean values, which implies 
that systematic trends are removed [Barnes et al., 
1971]. They might be due to ageing or to imperfect 
decoupling from environmental changes such as 
temperature, pressure, acceleration, or voltage. 
Characterization of drifts will be considered in 
section 8. 

2. The statistical properties of the stable fre- 
quency generators are described by a model which 
is stationary of order 2. This point has been fully 
discussed in the literature [Barnes et al., 1971; 
Boileau and Picinbono, 1976; Barnes, 1976]. This 
assumption allows one to derive useful results and 
to define simple data processing for the charac- 
terization of frequency stability. 

Actual experimental practice shows that, besides 
long-term frequency drifts, the frequency of a 
high-quality frequency source can be perturbed by 
a superposition of independent noise processes, 
which can be adequately represented by random 
fluctuations having the following one-sided power 
spectral density of fractional frequency fluctua- 
tions; 


SM" Sar fu) 


S,(/) is depicted in Figure |. Its dimensions are 
Hz~'. Lower values of a may be present in the 
spectral density of frequency fluctuations. They 
have not been clearly identified yet because of 
experimental difficulties related to very long term 
data acquisition and to control of experimental 
conditions for long times. Moreover, the related 
noise processes may be difficult to distinguish from 
systematic drifts. 

Finite duration of measurements introduces a 
low-frequency cutoff which prevents one from 
obtaining information at Fourier frequencies smaller 


Fig. 1. Asymptotic log-log plot os S, (/) for commonly encoun- 
tered noise processes. 


than 1/6, approximately, where 6 is the total dura- 
tion of the measurement [Cutler and Searle, 1966}. 
Alternatively, this made it possible to invoke physi- 
cal arguments to remove some possible mathemat- 
ical difficulties related to the divergence of S,(f) 
asf-- 0fora<6. 

Furthermore, high piss filtering is always present 
in the measuring instruments or in the frequency 
generator to be characterized. It insures conver- 
gence conditions at the higher-frequency side of 
the power spectra for a > 0. 

The spectral density of fractional phase fluctua- 
tions is also often considered. From (6), one can 
write, at least formally, 


SN) = (1/47), ® 


The dimensions of S,(/) are s’ Hz~'. Similarly, 
the spectral density of phase fluctuations ¢(¢) is 
such as 


SU) = 2v,)'S,) 1) 


It is expressed in (rad)? Hz~'. 

The quantity “(/) [Halford et al., 1973] is 
sometimes considered to characterize phase fluc- 
tuations. If phase fluctuations at frequencies >f 
are small compared with | rad, one has 

LN =tSLN (10) 
where S,(/) is the spectral density of phase fluc- 
tuations of the frequency generator considered. The 
definition of (f) implies a connection with the 
radio frequency spectrum, and its use is not recom- 
mended. 

Since the class of noise processes for which y(t) 
is stationary is broader than that for which the 
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TABLE 1. Designation of noise processes 
« Designation Class of Stationarity 


2 white noise of phase stationary phase 
fluctuations 

1 licker noise of phase stationary first-order 
phase increments 


stationary first-order 
phase increments 

1 flicker noise of frequency stationary second-order 
phase increments 

-2 random walk of frequency stationary second-order 
phase increments 


0 white noise of frequency 


phase is stationary [Boileau and Picinbono, 1976), 
Ss) should preferably be used in mathematical 
analysis. However, it is true that many experimental 
setups transduce ¢(f) into voltage fluctuations and 
allow one to experimentally determine an estimate 
of its power spectral density S,(f). 

Table 1 shows the designations of the noise 
processes considered. It also indicates the class 
of stationarity to which they pertain, as will be 
justified later on. 

S,U/) is one of the recommended definitions of 
frequency stability [Barnes et al., 1971}. It gives 
the widest information on frequency deviations y(t) 
within the limits stated previously. 


3. NOISE PROCESSES IN FREQUENCY GENERATORS 


The white phase noise (a = 2) predominates for 
S large enough. It is the result of the additive ther- 
mal (for the lower part of the electromagnetic 
spectrum, including microwaves) or quantum (for 


optical frequencies) noise which is unavoidably . 


superimposed on the signal generated in the oscilla- 
tor [Cutler and Searle, 1966). It leads to a one-sided 
spectral density S,(/) of the form FkTY?/v3P or 
Fhyv,f?/v3,P, depending on the frequency range, 
where k is Boltzmann's constant, A is Planck's 
constant, T is the absolute temperature, F is the 
noise figure of the components under consideration, 
and P is the power delivered by atoms. 

The flicker phase noise (a = 1) is generated mainly 
in transistors, where this noise modulates the cur- 
rent [Halford et al., 1968; Healey, 1972) . The theory 
of this noise is not yet very well understood. 
Diffusion processes across junctions of semicon- 
ductor devices may produce this noise. 

White noise of frequency (a = 0) is present in 
oscillators. It is the result of the noise perturbation 
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in the generation of the oscillation which is due 
to white noise within the bandwidth of the fre- 
quency-determining element of the oscillator [Bla- 
quiére, 1953a, b). It is often masked by other types 
of noise but has been observed in lasers [Siegman 
and Arrathoon, 1968] and more recently in masers 
[Vessot et al., 1977}. The one-sided spectral density 
of fractional frequency fluctuations is then kT /PQ* 
of hv,/PQ? depending on the frequency range, as 
stated above. Q is the quality factor of the fre- 
quency-determining element. 

White noise of frequency is typical of passive 
frequency standards such as cesium beam tube and 
rubidium cell devices as well as stabilized lasers. 
It is related to the shot noise in the detection of 
the resonance to which an oscillator is slaved [Cutler 
and Searle, 1966) . 

Flicker noise of frequency and the random walk 
frequency noise for which a = —! and —2, respec- 
tively, are sources of limitation in the long-term 
frequency stability of frequency sources, They are 
observed in active devices as well as passive ones. 
For instance, flicker and random walk frequency 
noises have been observed in quartz crystal resona- 
tors [Wainwright et al., 1974) and rubidium masers 
[Vanier es al., 1977}. The origin is not well under- 
stood yet. It might be connected, in the first case, 
with fluctuations in the phonon energy density 
[Musha, 1975]. 

Figures 3 and 5 show, for the purpose of illustra- 
tion, S,(f) for a hydrogen maser for 10° = f = 
3 Hz {Vessot et al., 1977] and for an iodine- 
stabilized He-Ne laser for 10°? = f= 100 Hz [Cérez 
et al., 1978}. In both cases, S,(f) is derived from 
the results of time domain frequency measurements 
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Fig. 2. Frequency stability, characterized by the root mean 
square of the two-sample variance of fractional frequency 
fluctuation, of a hydrogen maser. The part of the graph with 
typical of white noise of frequency. 
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SIA [He] 


Fig. 3. Spectral density of fractional frequency Muctuations 
‘of a hydrogen maser, The parts of the graph with slopes 0 
and 2 coincide with theoretical expectations. 


(see section 6.4), as shown in Figures 2 and 4 but 
is very close to theoretical limits specified above. 

Itis worth pointing out here that in systems where 
a frequency source is frequency slaved to a fre- 
quency reference or phase locked to another fre- 
quency generator the different kinds of noise in- 
volved are filtered in the system (Cutler and Searle, 
1966; C. Audoin, unpublished manuscript, 1976). 
In these cases, at the output of the system, one 
can find noise contributions pertaining to the model 
(7) but appearing on the Fourier frequency scale 
in an order different than that shown in Figure 
1, This is depicted in Figures 6 and 7 for the case 
of a cesium beam frequency standard consisting 
of a good quartz crystal oscillator which is frequency 
controlled by a cesium beam tube resonator. 

The model for the frequency fluctuations is more 
useful if the noise processes can be assumed to 
be gaussian ones (in particular, momenta of all 
orders can then be expressed with the help of 
momenta of second order). The deviation of the 
frequency being the result of a number of elementa- 
Ty perturbations, this assumption seems a reason- 
able one. Furthermore, the normal distribution of 
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0 Th) 
oT Ue 
Fig, 4, Frequency stability, characterized by the root mean 


square of the two-sample variance of fractional frequency 
fluctuations, of a He-Ne iodine-stabilized laser. 


F [H3) 
wry wo 


Fig. 5. Spectral density of fractional frequency fluctuations 
of a He-Ne iodine-stabilized laser. The solid line represents 
the spectral density of fractional frequency fluctuations corre- 
sponding to experimental results, and the dotted line represents 
the expected value of S,(/). 


y, the mean value of frequency fluctuations 
averaged over time interval + as defined in (16), 
has been experimentally checked for a = 2, 1, 0, 
and -1 [Lesage and Audoin, 1973, 1977]. This 
is shown in Figure 8 for white noise of frequency, 
for instance. 


4. MEASUREMENTS IN THE FREQUENCY DOMAIN * 


Measurement of power spectral density of fre- 
quency and phase fluctuations can be performed 
in the frequency domain for Fourier frequencies 
greater than a few 10°’ Hz owing to the availability 
of good low-frequency spectrum analyzers, 


4.1. Use of a frequency discriminator 


Frequency discriminators are of current use to 
characterize radio frequency and microwave gener- 
ators. A resonant device such as a tuned circuit 
or a microwave cavity acts as a transducer which 


syne] 


Fig. 6. Spectral density of fractional frequency fluctuations of 
& good quartz crystal oscillator. 


¥ See Appendix Note # 6 
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Fig. 7. Spectral density of fractional frequency fluctuations 
of the same quartz crystal oscillator as in Figure 6 but frequency 
controlled by a Cs beam tube resonance 


transforms frequency to voltage fluctuations. This 
method can be applied to optical frequency sources 
too, as shown in Figures 9 and 10. Here the source 
is, for instance, a CW dye laser, and the frequency 
selective device is a Fabry-Perot etalon. The second 
light pass allows one to compensate for the effects 
of amplitude fluctuations and to adjust to a null 
the mean value of the output voltage. The slope 
of this frequency discriminator equals | V MHz~', 
typically, with a good Fabry-Perot etalon in the 


Fig. 8. Distribution of counting time results for white fre- 
quency noise (cesium beam frequency standards, + = 10 s) 
in Galtonian coordinates. Circles represent the cumulative prob- 
ability corresponding to |r, — r| with + = (1). Solid lines 
correspond to the normal distribution of the same width. 
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Fig. 9. Principle of frequency to voltage transfer in a frequency 
discriminator. 


4.2. Use of a phase detector 


This technique is well suited for the study of 
frequency sources in the radio frequency domain 
0.2 MHz < v, < 500 MHz, in a range where very 
low noise balanced-diode mixers which utilize 
Schottky barrier diodes are available. This tech- 
nique has mainly been promoted by the National 
Bureau of Standards [Shoaf, 1971; Walls and Stein, 
1977}. 

Figure 11 shows the principle of the determination 
of the phase fluctuations in frequency multipliers, 
for instance. The two frequency multipliers are 
driven by the same source. A phase shifter is 
adjusted in order to satisfy the quadrature condition. 
One then has 


v(t) = Dig) - e(O)) ay 


where D is a constant and », and », are the phase 
fluctuations introduced in the devices under test. 
It is assumed that the mixer is properly used to 
allow a balance of the phase and amplitude fluctua- 
tions of the frequency source. 

This technique is often used to characterize phase 
fluctuations of two separate frequency sources of 
the same frequency. The quadrature condition is 


F Petalon differential 
re | Amplifier 
, a 
Photocells 


Fig. 10. Principle of frequency noise analysis of a dye laser. 


# See Appendix Note # 25 
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Fig. 11. Principle of measurement of phase noise with a high-quality balanced mixer used as # phase comparator. 


insured by phase locking the reference oscillator, 
number 2 of Figure 12, to the oscillator under test. 
Fluctuations of the output voltage u(r) at frequen- 
cies f larger than the frequency cutoff of the phase 
loop are proportional to phase fluctuations of 
oscillator number |. On the contrary, components 
of u(t) at frequencies smaller than the above fre- 
quency cutoff are representative of frequency fluc- 
tuations of oscillator number 1. 

The requirement of having a reference oscillator 
of the same quality as the oscillator to be tested 
may be inconvenient. It has recently been shown 
that the phase noise of a single oscillator can be 
measured by using the mixer technique, but with 
a delay line [Lance et al., 1977]. Figure 13 shows 
a schematic of the setup. The signal from the 
frequency source is split into two channels. The 
reference channel includes a phase shifter for the 
purpose of adjustment. It feeds one of the mixer 
inputs. The other channel delays the signal before 
it is applied to the second mixer input. It can be 
seen that the power spectra density of the mixer 
output is proportional to (2af+,)?S,(/), where 1, 
is the delay. The sensitivity of this technique is 
then reduced for low Fourier frequencies. However, 


a 


Frequency Control 


a(t) 


> output 


Fig. 12. Principle of phase noise measurement of oscillators 
‘A phase lock loop insures the phase quadrature of the two 
phase-compared signals. 


some signal to noise enhancement can be achieved 
in a more elaborate configuration with two differen- 
tial delay line systems in which cross-spectrum 
analysis is performed on the signal output from 
the two delay line systems [Lance et al., 1978). 

Another method has been proposed to determine 
the power spectrum of fractional frequency fluctua- 
tions of a single high-quality frequency source 
[Groslambert, 1977} . It is shown in Figure 14. Two 
auxiliary oscillators, which do not need to be of 
the same quality as the oscillator under test, are 
used. They are phase locked to the frequency 
generator to be characterized. The control voltages 
v,(t) and v,(t) are appropriately filtered in order 
to obtain, at their outputs, a voltage vi(t) = K,(@, 
— o) and v3(t)= K,(@, — $ ), respectively, where 
K, and K, are constants and the subscripts 0, 1, 
and 2 refer to the oscillator under test, oscillator 
number 1, and oscillator number 2, respectively. 
It can be shown that the cross-correlation function 
of vj and v; is proportional to the autocorrelation 
function of the frequency fluctuations of the 
oscillator under test. Its spectral density of frac- 
tional frequency fluctuations can then be obtained 
via Fourier transform. 


4.3. Precision of measurement in the frequency 
domain 


A spectrum analyzer includes a filter of bandwidth 
Af, centered at frequency f, a nonlinear device 
which measures the power in the filtered signal, 
and a low pass filter which integrates the output 
signal for the time 7. The integration time T is 
not infinite, and the filter bandwidth A/ is not 
extremely narrow. Only an estimate $(f, Af, T) 
of S(f) can then be obtained. Well-known results 
show that the precision p in the measurement of 
the power spectral density of a gaussian process 
is given by 
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Fig. 13. Principle of phase noise measurement of a single-frequency source with a delay line 


p=(T: by)? 
No attempt has been made, to our knowledge, to 
specify p more accurately for the different noise 
Processes which can be encountered in frequency 
metrology of stable sources. 


S. MEASUREMENTS IN THE TIME DOMAIN 


Time and frequency counting techniques are well 
known [Cutler and Searle, 1966). They are the 
easiest to implement to provide information on the 
low-frequency content (f = | Hz) of the power 
spectra of fractional frequency fluctuations. 


5.1. The beat frequency method 


A beat note at frequency v, is obtained from 
two frequency sources under test, with frequencies 
¥_ and v,, respectively, such that v, = vj. If Av, 


Fig. 14. Principle of phase noise measurement of a single high- 
quality frequency source with a correlator. 


* See Appendx Note # 26 


(12) and Av) denote the frequency fluctuations of the 


two sources and Av, the frequency fluctuations of 
the beat note, one has 

ay, Me 

1 

“ yw 


dy Avy 
M% 
The fractional frequency fluctuations of the beat 
note are then proportional to those of the frequen- 
cies v, and v, but multiplied by the factor v/v, 
which is much larger than unity. 

With stable generators at frequencies lower than 
approximately 100 GHz the frequency fluctuations 
are small enough that the beat note can be at low 
frequency. The counter is then used as a period 
meter, and a high precision in the measurement 
is achievable. 

Optical frequency standards show larger fre- 
quency fluctuations in absolute value. For instance, 
a laser stabilized at $00 THz (A = 0.6 pm) with 
a fractional frequency stability of | x 107" exhibits 
frequency fluctuations of $0 Hz. They can be easily 
measured if the beat note is at 50 MHz, say, when 
the counter is used as a frequency meter. In the 
case of iodine-stabilized He-Ne lasers the beat note 
is easily obtained by locking the two lasers to 
different hyperfine components of the considered 
iodine transition. Otherwise, the frequency offset 
technique is used [Barger and Hall, 1969}. 


(13) 


5.2. The time difference method 


The time difference method [Allan and Daams, 
1975] must be used with time standards which 
deliver pulses as time scale marks. Distant time 
comparison and synchronization by TV pulses, light 
pulses, Loran-C pulses, for instance, pertain to this 
category. It provides information on the relative 
phases of the two clocks under test. 

Time interval measurements being very precise 
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Fig. 15. Principle of the time difference method. 


(a precision of 10-100 ns is typical, depending on 
the class of the counter), they are also used with 
c.w. frequency generators, as shown in Figure 15. 
This method is then well suited to the case in which 
the frequency sources under test have the same 
nominal frequency v,, ¢.g., atomic frequency stan- 
dards. An auxiliary frequency source, such as a 
frequency synthesizer, with frequency v, allows 
one to obtain, at the output of the mixers, two 
beat notes at the desired frequency v, = |v, — 
vol. After amplification the zero crossing of one 
of the beat notes starts the time interval counter, 
and the zero crossing of the other beat note stops 
it. One has 

, = (v9/¥, K%q — 25) (14) 
where x, is the fractional phase fluctuation of the 
beat note and x, and x, that of the two frequency 
standards. For instance, with v, = 5 MHz, v, = 
0.5 Hz, and a precision in the time interval measure- 
ment of 0.1 ys a precision of 10~'*s at the nominal 
frequency v, is achieved. 


6. CHARACTERIZATION OF FREQUENCY STABILITY 
IN THE TIME DOMAIN 


6.1, Significance of experimental data 


It is well established that measurement in the 
time domain with an electronic counter samples 
phase increments and gives A, »(1,) defined as 


Aelh) = oh +) — lh) (Is) 


The phase increment A_(t,) is related to Yur the 
average over time interval [f,, ¢, + 1] of fractional 
frequency fluctuations. We have 


ios, 18 1 
be j y(t )dt’ =——-A. @ (44) (16) 
* Je 2nv,t 


where v, is the mean frequency of the processed 
signal. ay 

Samples of y, can be combined in many different 
ways. Some of those which have been considered 
will be reviewed here. On the other hand, the 
number of samples is finite, and the question arises 
as to the related uncertainty in the characterization 
of frequency stability and of the best use of the 
data. 


6.2. N-sample variance 


The sequence of measurement is as shown in 
Figure 16. The mean duration of each measurement 
is t, and T is the time interval between the begin- 
nings of them. 

In statistical estimation it is common to consider 
sample variance [Papoulis, 1965]. The N-sample 
variance of y, is defined as 


ny ar et) 
#o.t9-—§ (x-L Ez) ay 


& 
where the factor N/(N — 1) removes bias in the 
estimation, 

The dependence of the expectation value of the 
N-sample variance on the number N of samples, 
the sample time 1, and the power spectral density 
has been considered by Allan [1966] . We will only 
consider special cases in the following. 

It can be shown that computation of the average 
of the N-sample variance introduces a filtering of 
the power spectral density S,(/) [Barnes et al., 
1971]. We have 


(o3(N, T, 1) = j SMH (18) 
. 


H(/f)is the transfer function of a linear filter which 
has the following expression: 


m N [sinnf+ ]? 7 sinnfNT 
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Fig. 16. Sequence of time domain measurement. 
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For f such that 
wf/T<1 (20) 
we have 


NIN +1 
wut = =A ayn (21) 


Equation (21) shows that for finite N the integral 
in (18) will converge at the lower limit for a = 
—l and a = —2, as well as fora = 2, 1, and 
0. One sees that very low frequency components 
of S,(f) are best eliminated for small values of 
N. 


6.3. Variance of time-averaged frequency 
fluctuations 


When N goes to infinity, (o7(«, +, )) becomes 
o°(y,), the variance of time-averaged frequency 
fluctuations or of the first difference of phase 
fluctuations [Cutler and Searle, 1966] as given by 


a) = ()") (22) 
where angle brackets denote mathematical expecta- 
tion. 
In the presence of a single-pole low-pass filter 
with cutoff frequency f, we have the following re- 
lation between 3) and S,(f): 


= : ! 
o,)= \ SOT Par (23) 
° 5 
with 
Wl? = [4] oy 


Equation (24) shows that o°(y,) converges for a 
= 2, 1, 0 but diverges for flicker noise of frequency 
(a = —1) and random walk of frequency (a = —2). 
The variance o”(y,)is no longer used to characterize 
frequency stability. However, it is useful to relate 
the RF power spectral density to S,(f) [Rutman, 
1974a}. 


6.4. Two-sample variance 
For the special case N = 2, (17) gives 


(0) (2, T.2)) = > (eer — a)"? 5) 
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and we have 
(032, T, nf S$.) |? of 
eres | a 
(26) 
with 
spt, 
mn =2[ 2 ‘] Gina/TY 27) 
aft 


For small f, such that nfT < 1, |H,(/)|? varies 
as f*. The integral in (26) is thus defined for flicker 
noise of frequency (a = —1) and random walk of 
frequency (a = —2), as well as fora = 2, 1, and 
0. It is easy to show that the quantity (j,., - 
¥,) represents a second-order difference of phase 
fluctuations. It follows that second-order phase 
increments are stationary fora = —| and —2 (as 
specified in Table 1). 


6.4.1. Two-sample variance without dead time, 
The two-sample variance (Allan variance) without 
dead time, for T = +, is now generally accepted 
as the measure of frequency stability in the time 
domain. One sets 


23 (1) = (0302, 4. 1)) (28) 


Table 2 gives asymptotic expressions of o?(r) in 
the cases 2nf.+ > | and 2nf,+ < 1. Expressions 
of a3 (+) in the presence of a sharp high-frequency 
cutoff f, have been given by Barnes et al. [1971] 
for the case 2nf,7 > |. 

One sees in Table 2 that 0? (1) has a characteristic 
+ dependence for each type of noise considered, 


TABLE 2, Asymptotic expressions of the two-sample variance 
for the poise processes considered 


o(s) 


SW) laf > laf <1 
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a Sar? dy 
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= See Appendix Note # 27 
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such as o?(r) = k/t”. This is specified as follows 
for 2nf.1 > |: 


For a = —1 the a,(t) graph is a horizontal line, 
which justifies the designation ‘flicker floor’ for 
that part of the graph. 

Usually, under experimental conditions the rela- 
tion 2nf_+ > | is satisfied. The noise processes 
which perturb the oscillation can then be identified 
from a o,(t) graph if it is assumed that the afore- 
mentioned model of frequency fluctuations is valid. 
Table 2 shows in which cases o3(t) depends on 
the frequency cutoff. The latter must then be 
specified, 

The case 2nf.r < | is useful for the analysis 
of the effect of frequency of phase servocontrol 
loops where the frequency fluctuations of the fre- 
quency reference are low-pass filtered, Bias func- 
tions have been given to relate (1) the two-sample 
variance with and without dead time and (2) the 
two-sample variance to the N-sample variance 
(Barnes et al., 1971], 

6.4.2, Two-sample variance with dead time. 
General expressions for the N-sample variance with 
dead time have been given [Barnes er al., 1971] 
for useful values of a if the condition 2n/,+ > 
Lis satisfied. The case of the two-Sample variance 
with dead time has not been emphasized enough 
yet. Table 3 compares the two-sample variance with 
and without dead time when the condition 2nf_r 
> | is fulfilled. The condition of negligible dead 


TABLE 3. Comparison of the two-sample variance with and 
without dead time for 2n/,+ > 1 
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Fig. 17. The solid line represents the variation of h_,(07(2, 
T, 1) versus +/(T — +) for the flicker noise of frequency. 
The dotted line represents the asymptotic value for (T - +) 
<" 


time is then 2nf.(T — t) < 1, Results for 2nf,r 
| are also available {P. Lesage and C. Audoin, 
private communication, 1978). Table 3 shows that 
in the presence of -dead time, i.e., 20f.(T — 1) 
> I, the expression for the two-sample variance 
is noticeably modified for a = —1 and —2. 
The case of the flicker noise of frequency is 
particularly interesting. Figure 17 shows the varia- 
* tion of the two-sample variance with dead time 
as a function of +/(T — 1). The flicker floor does 
not exist anymore if the value of this ratio is 
modified when the sampling time 1 is changed. The 
identification of the noise process which perturbs 
the oscillation might then be wrong if the effect 
of dead time is not taken into account. 


6.5. Precision in the estimation of the two-sample 
variance 


Measurements are always of finite duration, and 
therefore the number of available values of y, is 
finite. We are then faced with the problem of the 
Precision in the estimation of the time domain 
frequency stability measurement. This is an impor- 
tant one because successive characterizations of 
the frequency stability of a given device allow one 
to get information on the stationarity of the pro- 
cesses involved in the perturbation of its frequency 
but within the limits of the precision of the charac- 
terization. Precision in the estimation of the fre- 
quency stability of individual oscillators of a set 
of p frequency generators (p > 2) [Gray and Allan, 


¥* See Appendix Note # 29 
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1974] critically depends on the precision of the 
P(p — |)/2 frequency comparisons which can be 
performed by arranging oscillators in pairs. Fur- 
thermore, the uncertainty in the determination of 
g,(1) translates directly into the uncertainty in 
determining the fh, coefficients if the frequency 
generator is perturbed by noise processes modeled 
by 7). 

The precision in the estimation of time domain 
measurements of frequency stability has been con- 
sidered by several authors [Tausworthe, 1972; Le- 
sage and Audoin, 1973, Yoshimura, 1978]. It has 
been determined for most of the experimental 
Situations which can be encountered in the two- 
sample variance characterization of frequency 
stability, with or without dead time (P. Lesage and 
C. Audoin, private communication, 1978). 

Calculation of the expectation value of the two- 
sample variance according to (25) requires an infinite 
number of data. But, in practice, only m counting 
results are available, and one calculates the estimat- 
ed average of the two-sample variance as follows: 


1 — im 
8702, Tr, a= on tena) 29) 

One can easily show that the expectation value 
of 67(2, T, 7, m) equals the averaged two-sample 
variance with dead time. Thus the finite number 
of measurements does not introduce bias in the 
estimation of the two-sample variance. 

The estimated averaged two-sample variance 
(EATSV) being a random function of m, we need 
to characterize the uncertainty‘ in the estimation. 
We thus introduce the variance of the EATSV, 
according to the common understanding of & 


variance. We set 
o* (83 (2, T, 1, m)] 
= ((83(02, T.1,m) = (032, T.2))]7) G0) 
With the expression (29) of the EATSV we get 
o* (82(2, T, +, m)] 


B= (ier — 94)? — 200302, 7,9) G2) 


The classical law of large numbers [Papoulis, 
1965] which states that the true variance of a sum 


ot 


with 
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of (m — 1) uncorrelated random variables decreases 
as 1/(m — 1), even for small values of (m — 1), 
does not apply here. We are considering the quanti- 
ties B, which are correlated because two adjacent 
differences (j,,, — y,) and (¥,, — J,.4) ate ob- 
viously not independent. 

Equation (31) can also be written as 


1 r, 
0° (8202, T. x, m)] = —— [= 
m-1(l4 


1 med ] 
+—— Sim-1-8F,] 03) 
Zim —1) &! 
with % 
PT, = (B,B,4) (34) 


T,, which does not depend on m, represents the 
autocorrelation coefficient of B, and B,_,. Since 
the same data are used in two adjacent pairs, the 
autocorrelation coefficient I’, , and possibly others, 
differs from zero. Equation (33) then shows that 
the 1/(m — 1) dependence also occurs for the 
random variables considered, but asymptotically for 
large enough values of (m — 1), 

The variance of the EATSV can be related to 
S,(f) if it is assumed that the quantities y, are 
normally distributed. This is a reasonable assump- 
tion, as shown in section 2. 

It is useful to introduce A(m), the fractional 
deviation of 8?(2, T +, m) defined as 


83 (2, Tat, m) — (03(2, T,1)) 


(35) 
(03 (2, T, 7) ost 


A(m) = 


The standard deviation o [A(m)] defines the preci- 
sion in the estimation of the two-sample variance. 
Expressions for o [A(m)] which are valid for m 
> 2 have been established for all possible values 
of 2nf.1 and 2nf.(T — +) but will not be given 
here. 

In practice, the time domain frequency stability 
of a frequency source is characterized by the 
standard deviation [83(2, T, r, m)] '/?. We there- 
fore consider 8 defined as 


Z (82(2, T.x, mm)? = (632, T. 9)'7 


36 
(o3(2, 7,2)! 


a(8) specifies the precision in the estimation of 
the time domain frequency stability measurement 
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Fig. 18. Variation of K_ as a function of r = T/+ for the 
commonly encountered noise processes and for 2#/,r = 10. 


from a limited number of data and allows one to 
draw error bars on a frequency stability graph. 
For 2nf,1 > | and m > | we have 


o(8) = Kimo"? (37) 
The values of K, are given as follows subject to 


the condition that the dead time is negligible, i.c., 
Inf (T- <I: 


a x 
2 09 
1 0.99 
0 087 
-1 07 
-2 0.75 


In the presence of dead time the values of K, 
depend on the noise process considered as well 
as the values of 2nf.r and r = T/r. Figure 18, 
valid for 2nf.+ = 10 shows that the dependence 
of K, with dead time is especially pronounced in 
the vicinity of r = | fora = | and 2. 


7. CHARACTERIZATION OF FREQUENCY STABILITY 
VIA FILTERING OF PHASE OR FREQUENCY NOISE 


Equations (27) and (28) show that the definition 
of the time domain measurement of frequency 
stability o7(r) involves a filtering of S,(/) ina linear 
filter. Figure 19 shows the impulse response of this 
filter, which represents the sequence of measure- 


Fig. 19. Impulse response of « linear filter which represents 
computation of two-sample variance. 


ment for T = +, and Figure 20 depicts the related 
transfer function. One can also consider the effect 
of filtering a voltage proportional to y(t) or x(t) 
in a physically realizable analog filter. 

A high pass filter of cutoff frequency 1/ar has 
been considered [Rutman, 1974b; Rutman and 
Sauvage, 1974]. Its input receives a voltage propor- 
tional to x(t). It is provided by a mixer used as 
a phase comparator. The rms value of the filtered 
signal is measured. When the frequency cutoff is 
changed, this rms value shows the same p versus 
a dependence as ‘shown in section 6.4.1. More 
interesting is a bandpass filter centered at the 
variable frequency f = 1/2r but with a fixed value 
of its quality factor. It allows one to distinguish 
white and flicker noise of phase, as it gives » = 
3 for a = 2; the » versus a dependence being 
otherwise unchanged for a = |, 0, —1, and —2. 

Similarly, a frequency discriminator, giving an 
output proportional to y(t), followed by two cas- 
caded resistance-capacitance (RC) filters and arms 
voltmeter allows one to obtain a useful approxi- 
mation of the two-sample variance. The filters 
insure low-pass and high-pass filtering with RC = 
1/2 [Wiley, 1977}. 


iff 


Fig. 20. Transfer function. of the linear filter with impulse 
response shown in Figure 19. 
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8. SPECTRAL ANALYSIS INFERRED FROM TIME 
DOMAIN MEASUREMENTS 


The methods of time domain characterization of 


frequency stability reviewed above allow one to 
identify noise process if they are described by 


2 
5" > Ae (8) 
a 
This may not be the case. Furthermore, it is of 
interest to determine the power spectral density 
of fractional frequency fluctuations for Fourier 
frequencies lower than | Hz. In this region, time 
domain measurements are the most convenient, and 
the question arises as to their best use for spectral 
analysis. 


8.1. Selective numerical filtering 


Equations (24) and (27) show that calculation of 
the variance of the second difference of phase 
fluctuations (the two-sample variance) involves a 
more selective filtering than calculation of the 
variance of the first difference of phase fluctuations. 
One can then consider higher-order differences 
[ Barnes, 1966; Lesage and Audoin, 1975a, b}. The 
nth-order difference of phase fluctuations is denot- 
ed as “A, o(1,), where + and T have the same 
meaning as in section 6.1. and 6.2. This nth dif- 
ference is defined by the following recursive equa- 
tion: 


67,04) =" "bs,e(4 + T)- "8, .0) 39) 


which introduces binomial coefficients C/_,. We 
have 


"A, .¢(4) = p> ‘CL (el, + (n- 1 - T+) 
6 


~el,+(@-1-HT)) (4) 
The transfer function H,(/f, T, 1) of the linear filter 
which represents the calculation of the variance 
of the nth difference of phase fluctuations is given 
by 


2 
1H,U. T, | = — (sin afT)*"' sin aft (41) 
aft 


It should be pointed out that for fr « 1, one 
has 


AG. T.ol=QnfTy' fret (42) 
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hyglt? : 


Fig. 21, Impulse response of a linear filter which represents 
computation of the variance of the 20th difference of phase 
fluctuations. C; represents binomial coefficients. 


Figure 21 shows the impulse response of the linear 
filter which represents the calculation of the 
variance of the 20th difference of phase fluctua- 
tions, and Figure 22 shows the related transfer 
function. A selective filtering is then involved 
around frequency | /2r. 

_ Such a variance is also known as a modified 
Hadamard variance [Baugh, 1971]. The spurious 
responses at frequencies (2/ + 1)/21, where / is 
an integer, can be eliminated by a proper weighting 


Fig. 22. Transfer function of the linear filter considered in Figure 
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of measurement results or by filtering with the help 
of an analog filter [Groslambert, 1976). 

Such a technique of linear filtering has been used 
to show that good quartz crystal oscillators exhibit 
flicker noise of frequency for Fourier frequencies 
as low as 10~? Hz [Lesage and Audoin, 1975b). 
Furthermore, it is well suited to the design of 
automated measurement setups [Peregrino and 
Ricci, 1976; Groslambert, 1977} . 

The best use of experimental time domain data 
for selective filtering has been considered by Boi- 
leau [1976], 


8.2. High-pass filtering 


If frequency fluctuations y(t) are filtered in an 
ideal high-pass filter with transfer function G,(/,, 
J) such that 


o s<h 
1 fh 
its output z(f) is such that 


Gh, = { (43) 


oe \ GUIS, Na = \ se 4) 
0 fi 
Equation (44) shows that the derivative of o? is 
-S,(f), and spectral analysis, and therefore 
characterization of frequency stability, are possible, 
in principle, by high-pass filtering. 

Possible realization of the high-pass filter by 
techniques of digital data processing have been 
specified, such as the method of fimite-time variance 
and the method of finite-time frequency control. 
Processing of finite-time data is aimed to properly 
deal with the nonintegrable singularity of the power 
spectral density at v = 0 [Boileau, 1975; Boileau 
and Picinbono, 1976]. The method is well suited 
to the analysis of drifts or slow frequency changes. 
Practical use of this method has not been reported 
yet. 


8.3. Use of the sample spectral density 


It has been shown in section 8.1. that spectral 
analysis from the Hadamard variance or its modified 
forms requires a series of measurements at time 
interval + in order to specify the spectral density 
at frequency 1/21. Another point of view has been 
considered [Boileau and Lecourtier, 1977). From 
a set of measurements of y,, sampled at frequency 
1/r, it allows one to obtain an estimation of the 


spectral density for discrete values of the Fourier 
frequency. 


9. STRUCTURE FUNCTIONS OF OSCILLATOR 
FRACTIONAL PHASE AND FREQUENCY 
FLUCTUATIONS 


Interest in the variance of nth-order difference 
of phase fluctuations was recognized early in the 
field of time keeping (see for instance, Barnes 
[1966]). This can be easily understood from (4), 
which shows that an efficient filtering of low- 
frequency components of frequency fluctuations 
is then introduced. It allows one to deal properly 
with frequency drifts, which will now be considered, 
and poles of S,(/) of order 2(m — 1) at the origin. 
It is equivalent to saying that the nth difference 
of phase fluctuations allows one to consider random 
processes with stationary nth-order phase incre- 
ments. 

This question has been formalized by Lindsey 
and Chie (1976, 1977], who introduce structure 
functions of oscillator phase fluctuations. The mth 
order structure function of phase fluctuations is 
nothing else but the variance of the nth difference 
of phase fluctuations, as considered in section 8. 
Then, by definition, the nth-order structure function 
of fractional phase fluctuations is given by 

Die) = E(1%8, 2) (45) 
where E (-} means expectation value. The fractional 
phase (or the clock reading) at time ¢, is x(t,). 
We assume T = +. 

Let us consider an oscillator, the phase ¢’(t) 
of which is of the following form except for an 
additive constant: 


eO= ary aor) (6) 


where 2, is a random variable modeling the kth- 
order frequency drift and ¢(t) represents random 
phase fluctuations. We then have 
r0-y 4c ee (47) 
moe 
ond 4,070) (48) 


where d, = 0,/21v, is the normalized drift coeffi- 
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cient and x(1) and y(f) have the same meaning as 
in the preceding sections. The notations x’ and y’ 
refer to an oscillator with drift. 

It can then be shown that we have 


D(a) = PE [d2_|) 


= sin’ (aft) 
2 —— = 
+2 js ayy af l=n (49) 
and 


. sin™ (nf) 
we) 2* | S. ———— t 50) 
Dr) \, UY anf? Y In (50) 
If one applies (49) to the case of an oscillator 
without drift, one can easily show that the following 
equations are satisfied: 


0? (y,) = (1/x7) DEX) (51) 
and 
(tr) = (1/22?) DOK) (52) 


This is indeed not surprising because apart from 
more or less complicated mathematical formalism 
the definitions of the considered variances and 
structure functions are closely related, as has been 
emphasized here. 

Relations between sample variance and structure 
functions have been given by Lindsey and Chie 
[1976], whereas the relation between structure 
functions and several different approaches of fre- 
quency stability characterization has been analyzed 
by Rutman [1977, 1978} 

For the generally accepted noise model defined 
by (7) the + dependence of higher-order structure 
functions is the same as the two-sample vanance, 
as shown in Table 4 [Lindsey and Chie, 19785). 
As stated above, structure functions of order 1 
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allow one to consider spectral densities which vary 
as f* at the origin with a 2 —2(n — 1). For instance, 
for n = 3 it is possible to characterize frequency 
fluctuations of an oscillator with a power spectral 
density of fractional frequency fluctuations given 
by Sf) = 32__, A,f*. This oscillator exhibits 
stationary third-order increments of phase fluctua- 
tions. 

In the presence of a frequency drift described 
by a polynomial of degree / — 1, structure functions 
of degree n </ are meaningless: their computation 
yields a time-dependent result. For n = / the /th 
structure function shows a long-term 1 dependence 
proportional to +”, This dependence disappears for 
n> |. Although a power spectral density of the 
form f~“~-") would also give the structure functions 
a variation of the form +”, this variation does not 
depend on x, provided that the function is meaning- 
ful. It is then possible, at least in principle, to 
identify frequency drifts and to specify their order. 
This is illustrated in Figure 23 according to Lindsey 
and Chie {1978b]. However, there are not yet 
experimental proofs that such a characterization 
is achievable in practice. 


10. POWER SPECTRAL DENSITY OF STABLE 
FREQUENCY SOURCES 


The power emitted by a source of time-dependent 
voltage u(r) given by (1) is S,(v) dv in the frequency 
range [v, v + dv], where S,(v) is the power spectral 
density of the source. The dimensions of S,(v) are 
Vv? Hz7', The main interest of power spectral 
density, in frequency metrology, is related to high- 
order frequency multiplication. We will only intro- 
duce the subject by giving the relations between 
S,(v) and S,(f) and stating present problems in 
the field. 


TABLE 4 Structure functions of orders |, 2, 3, and 4 for fractional phase Muctuations of commonly encountered noise processes 


for 2nf,1 > | 
SS) Din) DEX) DM) Dr), 
1 3 s 3 
aA? —h. aA SA =n, 
oi Parked yw ahh ye 
3 3s 
La A eh A, nef) Shyla (nf0) phi) 
7 
the a Shor 10h, 
JS 4h_.7? 2 6.75h_,* 27h 2? 
‘ 
af? pt hae whi Sathi? 


From Lindsey and Chie |19786) 
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Fig. 23. (Solid line) Two-sample variance of an oscillator 
showing a linear frequency drift of 10°” per day and flicker 
noise of frequency given by S,(/) = 7.2 x 10° f*', (Dotted 
line) The third difference of fractional phase fluctuation is 
independent of the drift (according to Lindsey and Chie {19785} . 


Negligible amplitude noise and gaussian phase 
fluctuations being assumed, it is well known that 
the autocorrelation function of u(t) is R,(t) given 
by 


A = 
R,(1) = a cos 2mv,1 exp [-1(2mv,)?07(y,)] (53) 


As oy) is only defined for stationary phase 
fluctuations and for phase fluctuations with station- 
ary first increments, the same is true for R,(r) and 
therefore S,(f). 


10.1. White noise of frequency 


This is the simplest to deal with. If the frequency 
of the source is perturbed by a broadband white 
noise of frequency, one has S,(f) = h, and o°(y,) 
= (h,/2x). Whence 


Vi It} 
R(x) = > cos deur exp (-=) (54) 
1 


where 1, is the coherence time of the signal. We 
have 


1, = (wvzh,)-! (5) 


The one-sided power spectral density is then repre- 
sented by a Lorentzian given by 
2wAv 


= 43 —___—_—_ 56 
St) ° (QmAv)? + (2e(v — vy)? (56) 


where Av is the half width at half maximum of 
the power spectra defined as 


2Ay = wth, (7) 


We obviously have 2nAv « +, = 1. If oscillators 
are considered, one has h, = k7/PQ* im the 
radiofrequency and microwave domain and h, = 
hvo/PQ* in the optical frequency domain, where 
P is the power delivered by the oscillator and Q 
the quality factor of the frequency-determining 
element. Table 5 gives theoretical values of co- 
herence time and linewidth of good oscillators. It 
is only intended to illustrate a comparison, often 
made, of the spectral purity of oscillators. It must 
be pointed out that, in practice, other noise pro- 
cesses exist which modify these results. Even any 
meaning of +, and Av is removed if R,(r) is not 
defined. 

Multiplication of the frequency by » multiplies 
Av and divides +, by the factor n’. 


10.2. White noise of'phase 


Presently available good quartz oscillators are 
affected by white noise of phase. It is easy to show 
from the definition (16) of y, that the following 
equation is satisfied: 


$ Pwvero(y)]? = R, 0) — Re) (58) 


where R,(1) denotes the autocorrelation function 
of the stationary phase fluctuations »(/). 

The expression of the one-sided S,(v) then fol- 
lows [Rutman, 1974a; Lindsey and Chie, 1978a]: 


ve 
Sv) = a FH 18 (v = vy) 


+ Sv — ve) + FS, 0)*S +>] (59) 


where the asterisk denotes convolution and the 
bracket contains an infinite set of multiple-convolu- 
tion products of S,(v) by itself. Such an equation 
is not easily tractable. It is the reason why the 


TABLE S. Theoretical values of correlation time and power 
spectrum linewidth for various oscillators 


Oscillator vy. Hz hy Hz"! os, 8 De, He 

S-MHz 

quartz xial §=Sx 10 4x10" 10% = 3.x 10" 
H maser 14x10, 4x10" 10" 3x 10" 


He-Nelaser 5x10 3x10" 107° 30 
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approximation of small-phase fluctuations is often 
made. If R,(0) = eo < |, one has 


“ww 
S.) = = €* [B(v — v9) + Sv = %)) (60) 


In this approximation the power spectrum consists 
of a carrier at frequency v, around which the 
spectrum of the phase fluctuations is translated, 

If the frequency of the signal is multiplied by 
n, the mean squared frequency fluctuation becomes 
n'g’. If n?@> < 1, the power spectral density 
is then given by 


= 
S00) = ae oF BW — ave) +S v—%)1 (61) 


The power in the carrier decreases, and the power 
in the pedestal increases. The relative powers in 
the carrier P_ and in the pedestal P, are then given 
by 


P=e 


(62) 


al (63) 


P,=1-e* 
respectively, where ¢” represents the mean squared 
value of phase fluctuations at the signal frequency 
considered. It has been proved that (62) and (63) 
are valid, even if the condition 6? < | is not 
satisfied (F. Clerc, private communication, 1977). 


Relating Power MB) 


ew 1 © Ow 
D fasion)? 


ow 9 


Fig. 24. Variation of the relative power in the carer P, and 
the pedestal P, as 4 function of *, the mean squared phase 
fluctuations. 
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Figure 24 shows the variation of P. and P, as 
a function of 7. One easily understands that the 
carrier may disappear if the multiplicative factor 
is high enough. This has been theoretically and 
experimentally investigated by Walls and de Marchi 
[1975], Bava et al. [19775], and Godone et al. 
[1978]. A signal has been synthesized at 761 GHz, 
starting from a 5-MHz quartz oscillator, which 
verifies theoretical conclusions. 


10.3. Other noise processes 


Much work remains to be done to analyze proper- 
ly the effect of noise such as the flicker noise of 
frequency or the random walk of frequency which 
contributes power very close to the carrier. The 
very interesting semiempirical approach by Halford 
[1971] has not yet been justified either theoretically 
of ¢xperimentally in a convincing manner. 


11. CONCLUSION 


Widely used theoretical and experimental meth- 
ods for the characterization of frequency stability 
in the time and frequency domain have been out- 
lined. Recently used or proposed experimental 
methods have been reviewed. The effect of dead 
time on the interpretation of time domain measure- 
ments, as well as on their precision has been 
emphasized, Recently introduced structure func- 
tions have been considered as well as their interest 
for the elimination of frequency drifts. The prob- 
lems in the relation between the radiofrequency 
power spectral density and the power spectral 
density of phase fluctuations have been briefly 
summarized. 
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I. Introduction 


Frequency sources contain noise that appears to be a superposition of 
causally generated signals and random, nondeterministic noises. The random 
noises include thermal noise, shot noise, and noises of undetermined origin 
(such as flicker noise). The end result is time-dependent phase and amplitude 
fluctuations. Measurements of these fluctuations characterize the frequency 
source in terms of amplitude modulation (AM) and phase modulation 
(PM) noise (frequency stability). 
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The term frequency stability encompasses the concepts of random noise, 
intended and incidental modulation, and any other fluctuations of the output 
frequency of a device. In general, frequency stability is the degree to which 
an oscillating source produces the same frequency value throughout a 
specified period of time. It is implicit in this general definition of frequency 
stability that the stability of a given frequency decreases if anything except 
a perfect sine function is the signal wave shape. 

Phase noise is the term most widely used to describe the characteristic 
randomness of frequency stability. The term spectral purity refers to the 
ratio of signal power to phase-noise sideband power. Measurements of phase 
noise and AM noise are performed in the frequency domain using a spectrum 
analyzer that provides a frequency window following the detector (double- 
balanced mixer). Frequency stability can also be measured in the rime 
domain with a gated counter that provides a time window following the 
detector. 

Long-term stability 1s usually expressed in terms of parts per million per 
hour, day, week, month, or year, This stability represents phenomena 
caused by the aging process of circuit elements and of the material used in 
the frequency-determining element. Short-term stability relates to frequency 
changes of less than a few seconds duration about the nominal frequency. 

Automated measurement systems have been developed for measuring the 
combined phase noise of two signal sources (the two-oscillator technique) 
and a single signal source (the single-oscillator technique), as reported by 
Lance er al. (1977) and Seal and Lance (1981). When two source signals 
are applied in quadrature to a phase-sensitive detector (double-balanced 
mixer), the voltage fluctuations analogous to phase fluctuations are measured 
at the detector output. The single-oscillator measurement system is usually 
designed using a frequency cavity or a delay line as an FM discriminator. 
Voltage fluctuations analogous to frequency fluctuations are measured at 
the detector output. 

The integrated phase noise can be calculated for any selected range of 
Fourier frequencies. A representation of fluctuations in the frequency 
domain is called spectral density graph. This graph is the distribution of 
power variance versus frequency. 


Il. Fundamental Concepts 


In this presentation we shall attempt to conform to the definitions. 
symbols, and terminology set forth by Barnes er al. (1970). The Greek 
letter y represents frequency for carrier-related measures. Modulation- 
related frequencies are designated /. If the carrier is considered as dc, the 
frequencies measured with respect to the carrier are referred to as baseband, 
offset from the carrier, modulation, noise, or Fourier frequencies. 
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Fig. | Sine wave characteristics: (a) voltage V changes with time r as (b) amplitude 
changes with phase angle 


A sine wave generator produces a voltage that changes in time ¢ as the 
amplitude V changes with the phase angle @, shown in Fig. |. Phase is mea- 
sured from a zero crossing, as illustrated by plotting the phase angle as the 
radius vector rotates at a constant angular rate determined by the frequency 
The ideal (perfect) sine-wave-related parameters are as follows: vo, average 
(nominal) frequency of the signal; v(r), instantaneous frequency of a signal 


ldo 
M0 = 5 FW: (1) 


Vy, nominal peak amplitude of a signal source output: t, period of an oscilla 
-ion (1/v9); Q, signal (carrier) angular frequency (rate of change of phase 
with time) in radians 


Q = 2xnvy; (2) 


M4, instantaneous angular frequency; V(r), instantaneous output voltage 
of a signal. For the ideal sine wave signal of Fig. !, in volts, 


V(t) = Vp sin(2xvgt). (3) 


The basic relationship between phase @, frequency v,, and time interval 
t of the ideal sine wave is given in radians by the following: 


= Invot, (4) 


where $(r) is the instantaneous phase of the signal voltage, V(r), defined for 
the ideal sine wave in radians as 


O(t) = 2nvor. (5) 
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The instantaneous phase $(1) of V(r) for the noisy signal is 
H(t) = 2nvot + H(t), (6) 


where (1) is the instantaneous phase fluctuation ahout the ideal phase 
2nvgt of Eq. (4). 

The simplified illustration in Fig. | shows the sine-wave signal perturbed 
for a short instant by noise. In the perturbed area, the Av and Ar relation- 
ships correspond to other frequencies, as shown by the dashed-line wave- 
forms. In this sense, frequency variations (phase noise) occur for a given 
instant within the cycle. 

The instantaneous output voltage V(r) of a signal generator or oscillator 
is now 


V(t) = (Vo + e(t)) sin(2rvor + A(t), (7) 


where V, and vp are the nominal amplitude and frequency, respectively, and 
a(t) and @Xr) are the instantaneous amplitude and phase fluctuations of the 


signal. 
It is assumed in Eq. (7) that 
; dt) F 
e(t)/Vo €@ 1 and a <1 for all (1), (0) = do/dt. (8) 
0 


Equation (7) can also be expressed as 
V(T) = [Vo + de(t)] sin[2nvor + bo + 60(1)), (9) 


where @po is a constant, 4 is the Auctuations operator, and de(r) and do(1) 

represent the fluctuations of signal amplitude and phase, respectively. 
Frequency fluctuations dv are related to phase fluctuations 5, in hertz, by 
52 _ 1 dis) 


jive = 


"Wein a” 10) 


Le., radian frequency deviation is equal to the rate of change of phase devia- 
tion (the first-time derivative of the instantaneous phase deviation), 

The fluctuations of time interval dt are related to fluctuations of phase 
69, in radians, by 


56 = (2nvo)6r. an 


In the following, y’is defined as the fractional frequency fluctuation or fraction- 
al frequency deviation. It is the dimensionless value of 6v normalized to the 
average (nominal) signal frequency vo, 


y= by (12) 
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where y(r) is the instantaneous fractional frequency deviation from the 
nominal frequency vy. 


A. Noise SIDEBANDS 


Noise sidebands can be thought of as arising from a composite of low- 
frequency signals. Each of these signals modulate the carrier-producing 
components in both sidebands separated by the modulation frequency, as 
illustrated in Fig. 2. The signal is represented by a pair of symmetrical 
sidebands (pure AM) and a pair of antisymmetrical sidebands (pure FM). 

The basis of measurement is that when noise modulation indices are 
small, correlation noise can be neglected. Two signals are uncorrelated if 
their phase and amplitudes have different time distributions so that they do 
not cancel in a phase detector. The separation of the AM and FM components 
are illustrated as a modulation phenomenon in Fig. 3. Amplitude fluctuations 
can be measured with a simple detector such as a crystal. Phase or frequency 
fluctuations can be detected with a discriminator. Frequency modulation 
(FM) noise or rms frequency deviation can also be measured with an am- 
plitude (AM) detection system after the FM variations are converted to 
AM variations, as shown in Fig, 3a. The FM-AM conversion is obtained 
by applying two signals in phase quadrature (90°) at the inputs to a balanced 
mixer (detector). This is illustrated in Fig. 3 by the 90° phase advances of 
the carrier. 


B.  Spectrat Density 


Stability in the frequency domain is commonly specified in terms of spectral 
densities. There are several different, but closely related, spectral densities 
that are relevant to the specification and measurement of stability of the 
frequency, phase, period, amplitude, and power of signals. Concise, tutorial 


CARRIER 
CARRIER 
CARRIER 
v 4Vn 
AADIAN FREQUENCY RADIAN FREQUENCY RADIAN FREQUENCY 
(a foi fe 


Fic. 2 (a) Carner and single upper sideband signals; (b) symmetrical sidebands (pure 
AM); (c) an antisymmetrical pair of sidebands (pure FM). % 
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Fic. 3. (a) Relationships of the FM signal to the carrier. (b) relationship of the AM signal 
to the carrier: (c) carner advanced 90° to obtain FM-AM conversion : (d) AM-FM conversion 


descriptions of twelve defined spectral densities and the relationships among 
them were given by Shoaf er al. (1973) and Halford et al. (1973). 

Recall that in the perturbed area of the sine wave in Fig. | the frequencies 
are being produced for a given instant of time. This amount of time the signal 
spends in producing another frequency is referred to as the probability 
density of the generated frequencies relative to vg. The frequency domain 
plot is illustrated in Fig. 4. A graph of these probability densities over a period 
of time produces a continuous line and is called the Power spectral density. 
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POWER (Hz"") 


Fic. 4 A power density plot. 


The spectral density is the distribution of total variance over frequency. The 
units of power spectral density are power per hertz; therefore, a plot of power 
spectral density obtained from amplitude (voltage) measurements requires 
that the voltage measurements be squared. 

The spectral density of power versus frequency, shown in Fig. 4, is a rwo- 
sided spectral density because the range of Fourier frequencies f is from 
minus infinity to plus infinity. 

The notation S,( /) represents the two-sided spectral density of fluctations 
of any specified time-dependent quantity g(r). Because the frequency band 
is defined by the two limit frequencies of minus infinity and plus infinity, 
the total mean-square fluctuation of that quantity is defined by 


+2 
Guana = [SSM (3) 

-2 
Two-sided spectral densities are useful mainly in pure mathematical analysis 


involving Fourier transformations. 
Similarly, for the one-sided spectral density, 


Gidevana = s SAD) af. (14) 
The two-sided and one-sided spectral densities are related as follows: 
f Sng =2f sa = f 5, df (sy 
-2 0 J 


where g, indicates one-sided and g, two-sided spectral densities. It is noted 
that the one-sided density is twice as large as the corresponding two-sided 
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spectral density. The terminology for single-sideband versus double-sideband 
signals is totally distinct from the one-sided spectral density versus two- 
sided spectral terminology. They are totally different concepts. The defini- 
tions and concepts of spectral density are set forth in NBS Technical Note 
632 (Shoaf et al., 1973). 


C. SPECTRAL DENSITIES OF PHASE FLUCTUATIONS IN THE 
FREQUENCY Domain 


The spectral density S,(f) of the instantaneous fractional frequency 
fluctuations jt) is defined as a measure of frequency stability, as set forth 
by Barnes er al. (1970). S,(/) 1s the one-sided spectral density of frequency 
fluctuations on a “per hertz™ basis, i.¢., the dimensionality is Hz~’. The 
range of Fourier frequency / is from zero to infinity. S,,(f), in hertz squared 
per hertz. 1s the spectral density of frequency fluctuations dv. It is calculated 
as 
(8 Veen)? 


Sul) = bandwidth used in the measurement Of 5¥;m 


(16) 


The range of the Fourier frequency f is from zero to infinity. 

The spectral density of phase fluctuations 1s a normalized frequency domain 
measure of phase fluctuation sidebands. S,,(f), in radians squared per 
hertz. is the one-sided spectral density of the phase fluctuations on a “per 
hertz” basis 
Su) = 50m 


bandwidth used in the measurement of 00,,, a7 


The power spectral densities of phase and frequency fluctuation are related by 
Sag 1) = WBS). (18) 
The range of the Fourier frequency f is from zero to infinity. 


Syl f). in radians squared Hertz squared per hertz is the spectral density 
of angular frequency fluctuations 6Q 


Stal f) = (20S). a9) 

The defined spectral densities have the following relationships: 
SP) = v8SP) = 229 Seal S) = FS cS): (20) 
Sil 1D = (Ley Seal ) = (vo SPS) = (SCF 77- (21) 


Note that Eq, (20) is hertz squared per hertz, whereas Eq, (21) is in radians 
squared per hertz. 
The term S_qp(v), in watts per hertz, is the spectral density of the (square 


® See Appendix Note # 30 
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root of) radio frequency power P. The power of a signal is dispersed over the 
frequency spectrum owing to noise, instability, and modulation. This con- 
cept is similar to the concept of spectral density of voltage fluctuations 
Sif). Typically, S,.(/) is more convenient for characterizing a baseband 
signal where voltage, rather than power, is relevant. S_qp{v) is typically 
more convenient for characterizing the dispersion of the signal power in 
the vicinity of the nominal carrier frequency vo. To relate the two spectral 
densities, it is necessary to specify the impedance associated with the signal. 

A definition of frequency stability that relates the actual sideband power 
of phase fluctuations with respect to the carrier power level, discussed by 
Glaze (1970). is called #(f). For a signal with PM and with no AM, #(/) 
is the normalized version of S ;p(v), with its frequency parameter f refer- 
enced to the signal's average frequency vp as the origin such that / equals 
v — vo. If the signal also has AM, (/) is the normalized version of those 
portions of S_;(v) that are phase-modulation sidebands. 

Because f is the Fourier frequency difference (v — vo), the range of f is 
from minus vo to plus infinity. Since ¥(/) is a normalized density (phase 
noise sideband power), 


[Cena en (22) 


¥(f) is defined as the ratio of the power in one sideband, referred to the 
input carrier frequency on a per hertz of bandwidth spectral density basis, 
to the total signal power, at Fourier frequency difference f from the carrier, 
per one device. It is a normalized frequency domain measure of phase fluctua- 
tion sidebands, expressed in decibels relative to the carrier per hertz: 


power density (one phase modulation sideband) 
carrier power : 


“f= (23) 
For the types of signals under consideration, by definition the two phase- 
noise sidebands (lower sideband and upper sideband, at —f and f from vo. 
respectively) of a signal are approximately coherent with each other, and 
they are of approximately equal intensity. 

It was previously show that the measurement of phase fluctuations (phase 
noise) required driving a double-balanced mixer with two signals in phase 
quadrature so the FM-AM conversion resulted in voltage fluctuations at 
the mixer output that were analogous to the phase fluctuations. The opera- 
tion of the mixer when it is driven at quadrature is such that the amplitudes 
of the two phase sidebands are added linearly in the output of the mixer, 
resulting in four times as much power in the output as would be present if 
only one of the phase sidebands were allowed to contribute to the output 


See Append Nowe #37 
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of the mixer. Hence. for| f| < vo, and considering only the phase modulation 
portion of the spectral density of the (square root of) power, we obtain 


Sl fD/ Vera)” & 4S arlvo + (Pre) (24) 
and, using the definition of (f), 
LEP) & [Samo + [VW Pro) & $Ssoll fd. (25) 


Therefore. for the condition that the phase fluctuations occurring at rates 
(f) and faster are small compared to one radian, a good approximation in 
radians squared per hertz for one unit is 


LUP) = Spel f). (26) 
If the small angle condition is not met, Bessel-function algebra must be used 
to relate ¥(f) to S,,(f). 


The NBS-defined spectral density is usually expressed in decibels relative 
to the carrier per hertz and 1s calculated for one unit as 


L(f) = 10 logl}S,,(/)] (27) 


It is very important to note that the theory, definitions, and equations previous! 
set forth relate to a single device. 


D. MODULATION THEORY AND SpecTRAL DENSITY 
RELATIONSHIPS 


Applying a sinusoidal frequency modulation f,, to a sinusoidal carrier 
frequency vo produces a wave that is sinusoidally advanced and retarded 
in phase as a function of times. The instantaneous voltage is expressed as, 


V(t) = Vy sin(2avot + Ad sin 2nf,t). 28) 


where S@ is the peak phase deviation caused by the modulation signal 

The first term inside the parentheses represents the linearly progressing 
phase of the carrier. The second term is the phase variation (advancing and 
retarded) from the linearly progressing wave. The effects of modulation can 
be expressed as residual f,, noise of as single-sideband phase noise. For 
modulation by a single sinusoidal signal, the peak-frequency deviation of 
the carrier (vq) 1s 


Avy = AO: fa. (29) 
4d = Avo) fa: (30) 


where /,, is the modulation frequency. This ratio of peak frequency deviation 
to modulation frequency 1s called modulation index m so that Ag = m and 


m= Mio Sm (Gl) 
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The frequency spectrum of the modulated carrier contains frequency 
components (sidebands) other than the carrier. For small values of modula- 
tion index (m < 1), as is the case with random phase noise, only the carrier 
and first upper and lower sidebands are significantly high in energy. The 
ratio of the amplitude of either single sideband to the amplitude of the 
carrier is 


WHITE OF PHASE 


Viy/Vo = m2. (32) 


z 
= 
¥ 
& 
z 


This ratio is expressed in decibels below the carrier and is referred to as dBc 
for the given bandwidth B: 


Vig Vo = 20 logim/2) = 20 log(Ava/2fn) 


Loc in 


wore eM (62) 


= 10 log(m,2)? = 10 log(Avg; (33) + 
If the frequency deviation is given in terms of its rms value, then Ps 2 
AVema = B¥9, 4/2. (G4) 2 3 
Equation (33) now becomes F = 
Vey Vo = Lf) = 20 1OR(OY my Ta) a i 
= 10 log(Avsmy y 2fea)?- Ff 


The ratio of single sideband to carrier power in decibels (carrier) per hertz is 


Fre. S- Spectral density relationships 


Lf) = 20 log(Avsms fn) — 3 (36) 
and, in decibels relative to one squared radian per hertz, 4 3 7 8 2 g 8 : g 3 2 
Stel) = 20 10g( A Vm! Sm) (37) (tH29p) WT 
The interrelationships of modulation index, peak frequency deviation, 
rms frequency, and spectral density of phase fluctuations can be found from e 8 a £ sg © 2 @ ®# 
the following: 
— NVIGWH 3HYNDS 3NO O14 3AILWI3Y BP NI (119%, 
$m = Avg/2fq = Mima ns (38) 
Se ES SS 
= 1Wexp( Hf) 10) = Sy): B% =. se se ee CU 
2 2 2? ¢: 2 &@ @ @ ® © & 
or 


dm = Avima/y Um = x) 10 exp(F(FY/ 10) = V 4S,,(/). (40) 
and 


m = Avo) fn = 28¥ rma! 
= 2 1 exp F(P)10) = 2/9S,(7)- (41) 
The basic relationships are plotted in Fig. 5. 


X30N! NOLLWINGOW 
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E. Nose PROCESSES 


The spectral density plot of a typical oscillator’s output is usually a com- 
bination of different noise processes. It is very useful and meaningful to 
categorize these processes because the first job in evaluating a spectral 
density plot is to determine which type of noise exists for the particular 
range of Fourier frequencies. 

The two basic categories are the discrete-frequency noise and the power-law 
noise process, Discrete-frequency noise is a type of noise in which there is 
a dominant observable probability, i.e., deterministic in that they can usually 
be related to the mean frequency, power-line frequency, vibration frequencies, 
or ac magnetic fields, or to Fourier components of the nominal frequency. 
Discrete-frequency noise is illustrated in the frequency domain plot of Fig. 6. 
These frequencies can have their own spectral density plots, which can be 
defined as noise on noise. 

Power-law noise processes are types of noise that produce a certain slope 
on the one-sided spectral density plot. They are characterized by their 
dependence on frequency. The spectral density plot of a typical oscillator 
output is usually a combination of the various power-law processes. 

In general, we can classify the power-law noise processes into five categor- 
ies. These five processes are illustrated in Fig. 5, which can be referred to with 
respect to the following description of each process. 


(1) Random walk F M (random walk of frequency). The plot goes down as 
Lf *. This noise is usually very close to the carrier and is difficult to measure. 
It is usually related to the oscillator’s physical environment (mechanical 
shock, vibration, temperature, or other environmental effects). 


Frequency 
FiG.6 A basic discrete-frequency signal display 
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(2) Flicker FM (flicker of frequency). The plot goes down as 1/f?. This 
noise is typically related to the physical resonance mechanism of the active 
oscillator or the design or choice of parts used for the electronic or power 
supply, or even environmental properties. The time domain frequency 
stability over extended periods is constant. In high-quality oscillators, this 
noise may be marked by white FM (1/f*) or flicker phase modulation 
OM (1). It may be masked by drift in low-quality oscillators. 

(3) White FM (white frequency, random walk of phase). The plot goes 
down as 1, f?. A common type of noise found in passive-resonator frequency 
standards. Cesium and rubidium frequency standards have white FM noise 
characteristic because the oscillator (usually quartz) is locked to the reso- 
nance feature of these devices. This noise gets better as a function of time 
until it (usually) becomes flicker FM (1/7?) noise. 

(4) Flicker @M (flicker modulation of phase). The plot goes down as 
1/f, This noise may relate to the physical resonance mechanism in an oscil- 
lator. It is common in the highest-quality oscillators. This noise can be 
introduced by noisy electronics—amplifiers necessary to bring the signal 
amplitude up to a usable level —and frequency multipliers. This noise can 
be reduced by careful design and by hand-selecting all components. 

(5) White @M (white phase), White phase noise plot is flat f°, Broadband 
phase noise is generally produced in the same way as flicker OM (1/f). Late 
stages of amplification are usually responsible. This noise can be kept low 
by careful selection of components and by narrow-band filtering at the output. 


The power-law processes are illustrated in Fig. 5. 


F. IyteGratep PHase Noise 


The integrated phase noise is a measure of the phase-noise contribution 
(rms radians, rms degrees) over a designated range of Fourier frequencies. 
The integration is a process of summation that must be performed on the 
measured spectral density within the actual IF bandwidth (B) used in the 
measurement Of 5¢,—:- Therefore, the spectral density S,(f) must be un- 
normalized to the particular bandwidth used in the measurement. Define 
Sf), in radians squared, as the unnormalized spectral density: 


SWCD) = 2(10 exp. ZU f) + 10 log B)/10) (42) 


Then, the integrated phase noise over the band of Fourier frequencies ( f, 10 f,) 
where measurements are performed using a constant IF bandwidth, in radians 
squared, 1s 


(la 
Sofi to fy) = ; SAN) df. (43) 


TN-203 


7, PHASE NOISE AND AM NOISE MEASUREMENTS 253 


of, in rms radians, 


Salhi to fy) = v ESCA) + Sh) = = SAT. (44) 


and the integrated phase noise in rms degrees is calculated as 


Sq( 360/22). (45) 
The integrated phase noise in decibels relative to the carrier is calculated as 
Sp = 10 log($Sj). (46) 


The previous calculations correspond to the illustration in Fig. 7, which 
includes two bandwidths (BI and B2) over two ranges of Fourier frequencies. 
In the measurement program, different IF bandwidths are used as set 
forth by Lance er al. (1977). The total integrated phase noise over the differ- 
ent ranges of Fourier frequencies, which are measured at constant band- 
widths as illustrated, is calculated in rms radians as follows: 
S.)' a (Su) a ae (SEE 
Soues = y (Sui)? + (Spa)? +--+ + (Spa)? (47) 
where it is recalled that the summation is performed in terms of radians 
squared, 


Fic. 7 Integrated phase noise over Fourier frequency ranges at which measurements 
were performed using constant bandwidth. : 


254 A. L. LANCE, W. D. SEAL, AND F, LABAAR 


G. AM Noise In THE Frequency Domain 


The spectral density of AM fluctuations of a signal follows the same 
general derivation previously given for the spectral density of phase flucta- 
tions. Amplitude fluctuations de of the signal under test produces voltage 
fluctuations 54 at the output of the mixer. Interpretating the mean-square 
fluctuations de and 6 in spectal density fashion, we obtain S,,( f), the spectral 
density of amplitude fluctuations de of a signal in volts squared per hertz: 


Saf) = (Vo (Saal SMA rma)? (48) 


The term »( f) is the normalized version of the amplitude modulation (AM) 
portion of S_ 7p). with its frequency parameter f referenced to the signal's 
average frequency vg, taken as the origin such that the difference frequency 
f equals v — vo. The range of Fourier frequency difference / is from minus 
Vo to plus infinity 

The term » / )1s defined as the ratio of the spectral density of one amplitude- 
imodulared sideband to the total signal power, at Fourier frequency difference 
f from the signal's average frequency vp, for a single specified signal or device. 
The dimensionality is per hertz. #(/) and m(f) are similar functions; the 
former is a measure of phase-modulated (PM) sidebands, the later is a cor- 
responding measure of amplitude-modulated (AM) sidebands. We introduce 
the symbol »(f) to have useful terminology for the important concept of 
normalized AM sideband power. 

For the types of signals under consideration, by definition the two ampli- 
tude-fluctuation sidebands (lower sideband and upper sideband, at —/f 
f from vo, respectively) of a signal are coherent with each other, Also, they 
are of equal intensity. The operation of the mixer when it is driven at colinear 
phase is such that the amplitudes of the two AM sidebands are added linearly 
in the output of the mixer, resulting in four times as much power in the output 
as would be present if only one of the AM sidebands were allowed to contri- 
bute to the output of the mixer. Hence, for | f| < vo, 


SALW Acms)? = 4[Syaplvo + S)1/Pro (49) 
and, using the definition 
af) © [Salvo + SIV Pron (50) 
we find, in decibels (carrier) per hertz. 


aed f) = (1/2V 35a) 1). (51) 
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III. Phase-Noise Measurements Using the Two-Oscillator * 
Technique 


A functional block diagram of the two-oscillator system for measuring 
phase noise is shown in Fig. 8. NBS has performed phase noise measurements 
since 1967 using this basic system. The signal level and sideband levels can 
be measured in terms of voltage or power. The low-pass filter prevents local 
oscillator leakage power from overloading the spectrum analyzer when 
baseband measurements are performed at the Fourier (offset) frequencies 
of interest. Leakage signals will interfere with autoranging and with the 
dynamic range of the spectrum analyzer. 

The low-noise, high-gain preamplifier provides additional system sensi- 
tivity by amplyfying the noise signals to be measured. Also, because spectrum 
analyzers usually have high values of noise figure, this amplifier is very de- 
sirable. As an example, if the high-gain preamplifier had a noise figure of 
3 dB and the spectrum analyzer had a noise figure of 18 dB, the system sensi- 
livity at this point has been improved by 15 dB. The overall system sensitivity 
would not necessarily be improved 15 dB in all cases, because the limiting 
sensitivity could have been imposed by a noisy mixer. 


NOISY SIGNAL 


(THIS 1S THE QUANTITY 
TO BE MEASURED) 


OSCILLATOR 
UNOER TEST 


NOISE ONLY 


SMALL 
FLUCTUATIONS: 


SPECTRUM 
ANALYZER 


AMPLIFIER 


REFERENCE NO NOISE 
OSCHLATOR 
Fic. 8 The two-oscillator technique for measuring phase noise. Small fluctuations from 
nomunal voltage are equivalent to phase variations. The phase shifter adjusts the two signals 
to quadrature in the mixer, which cancels carners and converts phase noise to fluctuating de 
voltage 


See Append Nowe #6 


256 A. L. LANCE, W. D. SEAL, AND F. LABAAR 


Assume that the reference oscillator is perfect (no phase noise), and that it 
can be adjusted in frequency. Also, assume that both oscillators are extremely 
stable, so that phase quadrature can be maintained without the use of an 
external phase-locked loop or reference. The double-balanced mixer acts 
as a phase detector so that when two input signals are identical in frequency 
and are in phase quadrature, the output is a small fluctuating voltage. This 
represents the phase-modulated (PM) sideband component of the signal 
because, due to the quadrature of the signals at the mixer input, the mixer 
converts the amplitude-modulated (AM) sideband components to FM, and 
at the same time it converts the PM sideband components to AM. These 
AM components can be detected with an amplitude detector, as shown in 
Fig. 3, 

If the two oscillator signals applied to the double-balanced mixer of Fig. 8 
are slightly out of zero beat, a slow sinusoidal voltage with a peak-to-peak 
voltage ¥,,, can be measured at the mixer output. If these same signals 
are returned to zero beat and adjusted for phase quadrature, the output of 
the mixer is a small fluctuating voltage (dv) centered at zero volts. If the 
fluctuating voltage is small compared to }V,,,, the phase quadrature con- 
dition 1s being closely maintained and the “small angle” condition is being 
met. Phase fluctuations in radians between the test and reference signals 
(phases) are 


56 = Kd, — o,). (52) 


These phase fluctuations produce voltage fluctuations at the output of the 
mixer, 


bv = 4¥y550, ($3) 


where phase angles are in radian measure and sin 6@ = 5¢ for small 5d 
(6@ < | rad). Solving for 6@, squaring both sides, and taking a ume average 
gives 


SO)? > = 4C(5eY? D/A Voup)*s (54) 
where the angle brackets represent the time average. 
For the sinusoidal beat signal, 
(Vag)? = 8 Vim)? (55) 


The mean-square fluctuations of phase 5@ and voltage dv interpreted in a 
spectral density fashion gives the following in radians squared per hertz 


Srol f) = Sse £2 ems)? (36) 


Here. S,.(f), in volts squared per hertz, is the spectral density of the voltage 
fluctuations at the mixer output. Because the spectrum analyzer measures 
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rms voltage, the noise voltage is in units of volts per square root hertz, which 
means volts per square root bandwidth. Therefore, 


Saf) = [5 mg: BY = (iv ems)? B, (37) 

where B is the noise power bandwidth used in the measurement. 
Because it was assumed that the reference oscillator did not contribute any 
noise, the voltage fluctuations v,,,, represent the oscillator under test, and 


the spectral density of the phase fluctuations in terms of the voltage measure- 
ments performed with the spectrum analyzer, in radians squared per hertz, is 


Ssol L) = $((5v m5)?! Bl Vins)? )- (58) 
Equation (46) is sometimes expressed as 
Ss f) = Sul VK? (59) 


where K is the calibration factor in volts per radian. For sinusoidal beat 
signals, the peak voltage of the signal equals the slope of the zero crossing 
in volts per radian. Therefore, (V,)? = 2(Vims)*, which is the same as the 
denominator in Eq. (56). 

The term S,,( /) can be expressed in decibels relative to one square radian 
per hertz by calculating 10 log S,,( /) of the previous equation 


Spo S) = 20 10g(St ms) — 20 108( Vimy) — 10 log(B) — 3. (60) 


A correction of 2.5 is required for the tracking spectrum analyzer used in 
these measurement systems. #( f) differs by 3 dB and is expressed in decibels 
(carrier) per hertz as 


LS) = 20 108(50;m4) — 20 108( Ving) — 10 log(B) — 6. (61) 


A. Two Noisy Osciitators 


The measurement system of Fig. 6 yields the output noise from both 
oscillators. If the reference oscillator is superior in performance as assumed 
in the previous discussions, then one obtains a direct measure of the noise 
characteristics of the oscillator under test. 

If the reference and test oscillators are the same type, a useful approxima- 
ton is to assume that the measured noise power is twice that associated 
with one noisy oscillator. This approximation is in error by no more than 
3 dB for the noisier oscillator, even if one oscillator is the mayor source of 
noise. The equation for the spectral density of measured phase fluctuations 
in radians squared per hertz is 


s,u)) + Wom) = |25.6/) 


Newodevicest 


Sul) +54). - 


fone device) 


(62) 
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The measured value 1s therefore divided by two to obtain the value for the 
single oscillator. A determination of the noise of each oscillator can be made 
if one has three oscillators that can be measured in all pair combinations. 
The phase noise of each source 1, 2. and 3 1s calculated as follows 


Hy f) = 10 logl4(107 24" 98 4 107041 FY — Oy), (63) 
PA J) = 10 loglA OZ 80 4 1QH2NN 10 OF I1) (BM) 
LU) = UW loglH10% 9 + 1072119 — gFANy) (65) 


B. AUTOMATED PHaSE-NoIsE MEASUREMENTS USING THE 
Two-OscILLATOR TECHNIQUE 


The automated phase-noise measurement system is shown in Fig, 9. It is 
controlled by a programmable calculator. Each step of the calibration and 
measurement sequence is included in the program. The software program 
controls frequency slection, bandwidth settings, settling time, amplitude 
tanging, measurements, calculations, graphics, and data plotting. Normally. 
the system 1s used to obtain a direct plot of #(/). The integrated phase noise 
can be calculated for any selected range of Fourner frequencies. 

A quasi-contunuous plot of phase noise performance ¥(f) is obtained 
by performing measurements at Fourier frequencies separated by the IF 
bandwidth of the spectrum analyzer used during the measurement. Plots of 
other defined parameters can be obtained and plotted as desired. 

The IF bandwidth settings for the Fourier (offset) frequency-range 
selections are shown in the following tabulation: 


IF Fourier iF Fourier 
bandwidth frequency bandwidth frequency 
(Hz «kHz tkH2) (kHz) 

3 0001-04 1 40-100 
10 ra 3 100-400 
0 is 10 400-1300, 

100 +10 
200 10-40 


The particular range of Fourier frequencies 1s limited by the particular 
spectrum analyzer used in the system. A fast Founer analyzer (FFT) is also 
incorporated in the system to measure phase noise from submillihertz 10 
2S kHz. 

High-quality sources can be measured without multiplication to enhance 
the phase noise prior to downconverting and measuring at baseband fre- 
quencies. The measurements are not completely automated because the 
calibration sequence requires several manual operations. 
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Fic.9 An automated phase-noise measurement system. 


C. CALIBRATION AND MEASUREMENTS USING THE 
Two-OSCILLATOR SYSTEM 


¥({)1sa normalized frequency domain measure of phase-fluctuation side- 
band power. The noise power is measured relative to the carrier power 
level. Correction must be applied because of the type of measurement and 
the characteristics of the measurement equipment. The general procedure 
for the calibration and measurement sequence includes the following 
measuring the noise power bandwidth for each IF bandwidth setting on the 
Tracking Spectrum Analyzer (Section III.C.1); establishing a carrier refer- 
ence power level referenced to the output of the mixer (Section IILC.2); 
obtaining phase quadrature of the two signals applied to the mixer (Section 
IILC.3); measuring the noise power at the selected Fourier frequencies 
(Section III.C.4); performing the calculations and plotting the data (Section 
IILC.5), and measuring the system noise floor characteristics, usually re- 
ferred to as the system sensitivity. 


|. Noise-Power Bandwidth 


Approximations of analyzer-noise bandwidths are not adequate for phase 
noise measurements and calculations. The IF noise-power bandwidth of the 
tracking spectrum analyzer must be known and used in the calculations of 
phase noise parameters. Figure 10 shows the results of measurements per- 
formed using automated techniques. For example, with a 1-MHz signal 
input to the tracking spectrum analyzer, the desired incremental frequency 
changes covering the IF bandwidth are set by calculator control. 
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NOISE BANDWIDTH: 3.281 He 


FREQUENCY 


Fic 10 Plot of automated nowse-power bandwidth, 


The spectrum analyzer power output is recorded for each frequency setting 
over the range, as illustrated in Fig. 10. The 40-dB level and the 100 incre- 
ments in frequency are not the minimum permissible values. The recorded 
can be plotted for each IF bandwidth, as illustrated, and the noise-power 
bandwidth is calculated in hertz as 


(Py + Ppt Py tin + PIAS 


peak power reading we (C8 


noise power bandwidth = 
where Afis the frequency increment in hertz and the peak power is the maxi- 
mum measured point obtained during the measurements. All power values 
are in watts. 


2. Setting the Carrier Power Reference Level 


Recall from Section II1.6 that for sinusoidal signals the peak voltage of 
the signal equals the slope of the zero crossing. in volts per radian. A frequency 
offset is established, and the peak power of the difference frequency 1s mea- 
sured as the carrier-power reference level; this establishes the calibration 
factor of the mixer in volts per radian. 

Because the precision IF attenuator is used in the calibration process, one 
must be aware that the impedance looking back into the mixer should be 
50 Q. Also, the mixer output signal should be sinusoidal. Fischer (1978) 
discussed the mixer as the “critical element” in the measurement system. 
It is advisable to drive the mixer so that the sinusoidal signal is obtained 
at the mixer output. In most of the TRW systems, the mixer drive levels are 
10 dBm for the reference signal and about zero dBm for the unit under test. 
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System sensitivity can be increased by driving the mixer with high-level 
signals that lower the mixer output impedance to a few ohms. This presents 
a problem in establishing the calibration factor of the mixer. because it 
might be necessary to calibrate the mixer for different Fourier frequency 
ranges. 

The equation sensitivity = slope = beat-note amplitude does not hold 
if the output of the mixer is not a sine wave. The Hewlett-Packard 3047 
automated phase noise measurement system allows accurate calibration 
of the phase-detector sensitivity even with high-level inputs by using the 
derivative of the Fourier representation of the signal (the fundamental and 
its harmonics). The slope at @ = 0 radians is given by 


Asin @ — Bsin 36 + C sin $@ = A cos @ — 3B cos 3 + SC cos S@ 
=A-3B+SC+-- (67) 
Referring to Fig. 9, the carrier-power reference level is obtained as follows. 


(1) The precision IF step attenuator is set to a high value to prevent 
overloading the spectrum analyzer (assume 50 dB as our example). 

(2) The reference and test signals at the mixer inputs are set to approxi- 
mately 10 dBm and 0 dBm, as previously discussed. 

(3) If the frequency of one of the oscillators can be adjusted, adjust its 
frequency for an IF output frequency in the range of 10 to 20 kHz. If neither 
oscillator is adjustable, replace the oscillator under test with one that can 
be adjusted as required and that can be set to the identical power level of the 
oscillator under test, 

(4) The resulting IF power level is measured by the spectrum analyzer. 
and the measured value is corrected for the attentuator setting, which was 
assumed to be 50 dB. The correction is necessary because this attenuator 
will be set to its zero decibel indication during the measurements of nouse 
power. Assuming a spectrum analyzer reading of —40 dBm, the carrer- 
power reference level is calculated as 


carrier power reference level = S0dB - 40 dBm = 10dBm. (68) 
3. Phase Quadrature of the Mixer Input Signals 


After the carrier-power reference has been established, the oscillator under 
test and the reference oscillator are tuned to the same frequency, and the 
original reference levels that were used during calibration are reestablished. 
The quadrature adjustment depends on the type of system used. Three 
possibilities, illustrated in Fig. 9, are described here. 


(1) Ifthe oscillators are very stable, have high-resolution tuning, and are 
not phase-locked, the frequency of one oscillator is adjusted for zero de 
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voltage output of the mixer as indicated by the sensitive oscilloscope. 
Note: Experience has shown that the quadrature setting is not critical if the 
sources have low AM noise characteristics. As an example, experiments 
performed using two HP 3335 synthesizers showed that degradation of the 
phase-noise measurement became noticeable with a phase-quadrature 
offset of 16 degrees. 

(2) Ifthe common reference frequency is used, as illustrated in Fig. 9, then 
it Is necessary to include a phase shifter in the line between one of the oscil- 
lators and the mixer (preferably between the attenuator and mixer). The 
phase shifter 1s adjusted to obtain and maintain zero volts dc at the mixer 
output. A correction for a nonzero de value can be applied as exemplified by 
the HP 3047 automated phase-noise measurement system. 

(3) Ione oscillator 1s phase-locked using a phase-locked loop. as shown 
dotted in on Fig. 9. the frequency of the unit under test is adjusted for zero 
de output of the mixer as indicated on the oscilloscope. 


A phase-locked loop is a feedback system whose function is to force a 
voltage-controlled oscillator (VCO) to be coherent with a certain frequency, 
.e., 1s highly correlated in both frequency and phase. The phase detector 
4s a mixer circuit that mixes the input signal with the VCO signal. The mixer 
output is y, + vq. when the loop is locked. the VCO duplicates the input 
frequency so that the difference frequency is zero, and the output is a de 
voltage proportional to the phase difference. The low-pass filter removes 
the sum frequency component but passes the dc component to control the 
VCO. The time constant of the loop can be adjusted as needed by varying 
amplifier gain and RC filtering within the loop. 

A loose phase-locked loop is characterized by the following. 


(1) The correction voltage varies as phase (in the short term) and phase 
variations are therefore observed directly 

(2) The bandwidth of the servo response is small compared with the 
Fourier frequency to be measured. 

(3) The response time 1s very slow. 


A tight phase-locked loop 1s charactenized by the following. 


(1) The correction voltage of the servo loop varies as frequency. 

(2) The bandwidth of the servo response 1s relatively large. 

(3) The response time ts much smaller than the smallest time interval t 
at which measurements are performed. 


Figure 1] shows the phase-noise characteristics of the H.P. 8640B synthe- 
sizer measured at $12 MHz. The phase-locked-loop attenuation character- 
istics extend to 10 kHz The internal-oscillator-source characteristics are 
plotted at Fourier frequencies beyond the loop-bandwidth cutoff at 10 kHz. 
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Fig. 11 Phase-locked-loop characteristics of the H.P. 8640B signal generator, showing 
the normalized phase-noise sideband power spectral density. 


4. Measurements, Calculations, and Data Plots 


The measurement sequence is automated except for the case where manual 
adjustments are required to maintain phase quadrature of the signals, After 
phase quadrature of the signals to the mixer is established, the [F atten- 
uator is returned to the zero-decibel reference setting. This attenuator 1s 
set to a high value (assumed to be 50 dB in Eq. (65)] to prevent saturation 
of the spectrum analyzer during the calibration process. 

The automated measurements are executed, and the direct measurement 
and data plot of ¥(/) is obtained in decibels (carrier) per hertz using the 
equation 


£(f) = — (carrier power level — (noise power level — 6 + 2.5 
— 10 log B — 3)). (69) 


The noise power (dBm) is measured relative to the carrier-power level 
(dBm), and the remaining terms of the equation represent corrections that 
must be applied because of the type of measurement and the characteristics 
of the measurement equipment, as follows. 


(1) The measurement of noise sidebands with the signals in phase 
quadrature requires the —6-dB correction that is noted in Eq. (69), 

(2) The nonlinearity of the spectrum analyzer’s logarithmic IF amplifier 
results in compression of the noise peaks which, when average-detected, 
require the 2.5-dB correction. 

(3) The bandwidth correction is required because the spectrum analyzer 
measurements of random or white noise are a function of the particular 
bandwidth used in the measurement, 
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(4) The —3-dB correction is required because this is a direct measure of 
(f) of rwo oscillators, assuming that the oscillators are of a similar type 
and that the noise contribution is the same for each oscillator. If one oscil- 
lator is sufficiently superior to the other, this correction is not required. 


Other defined spectral densities can be calculated and plotted as desired. 
The plotted or stored value of the spectral density of phase fluctuations 
in decibels relative to one square radian (dBc rad?/Hz) is calculated as 

Soff) = LIP) + 3. (70) 


The spectral density of phase fluctuations, in radians squared per hertz, is 
calculated as 


Sao f) = 10 exp(Sso( 11/10), (71) 
The spectral density of frequency fluctuations, in hertz squared per hertz, is 
Sw I) = LS sgh J). (72) 


where S,,(F) is in decibels with respect to | radian. 
S$. System Noise Floor Verification 


A plot of the system noise floor (sensitivity) is obtained by repeating the 
automated measurement procedures with the system modified as shown in 
Fig. 12. Accurate measurements can be obtained using the configuration 
shown in Fig. 12a. The reference source supplies 10 dBm to one side of the 
mixer and 0 dBm to the other mixer input through equal path lengths; 
phase quadrature 1s maintained with the phase shifter. 


G }— ---  A)------ 50-1 
i (2) TERMINATION 


008m 
+10 68m 
PHASE 
SHIFTER 
+1048 
tal (by 


Fic 12 System configurations for measuring the system noise floor {sensitivity}: (a) 
configuration used for accurate measurements; (b) alternate configuration sometimes used. 
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The configuration shown in Fig. 12b is sometimes used and does not 
greatly degrade the noise floor because the reference signal of 10 dBm is 
larger than the signal frequency. See Sections IV.B and [V.C.4 for additional 
discussions related to system sensitivity and recommended system evaluation. 

Proper selection of drive and output termination of the double-balanced 
mixer can result in improvement by 15 to 25 dB in the performance of phase- 
noise measurements, as discussed by Walls et al. (1976). The beat frequency 
between the two oscillators can be a sine wave, as previously mentioned, 
with proper low drive levels. This requires a proper terminating impedance 
for the mixer. With high drive levels, the mixer output waveform will be 
clipped. The slope of the clipped waveform at the zero crossings, illustrated 
by Walls er al. (1976), is twice the slope of the sine wave and therefore im- 
proves the noise floor sensitivity by 6 dB, i.e. the output signal, proportional 
to the phase fluctuations, increases with drive level. This condition of clipping 
requires characterization over the Fourier frequency range, as previously 
mentioned for the Hewlett-Packard 3047 phase noise measurement system. 
An amplifier can be used to increase the mixer drive levels for devices that 
have insufficient output power to drive the double-balanced mixers. 

Lower noise floors can be achieved using high-level mixers when available 
drive levels are sufficient. A step-up transformer can be used to increase 
the mixer drive voltage because the signal and noise power increase in the 
same ratio, and the spectral density of phase of the device under test is un- 
changed, but the noise floor of the measurement system is reduced, 

Walls er al. (1976) used a correlation technique that consisted primarily 
of two phase-noise measurement systems. At TRW the technique is used as 
shown in Fig. 13. The cross spectrum is obtained with the fast Fourier 


transform (FFT) analyzer that performs the product of the Fourier trans-- 


form of one signal and the complex conjugate of the Fourier transform of 


ou 
CHANNEL 
FFT 


FiG. 13. Cross-spectrum measurement using the two-oscillator technique. 
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the second signal. This cross spectrum, which is a phase-sensitive character- 
istic, gives a phase and amplitude sensitivity measure directly. A signal- 
to-noise enhancement greater than 20 dB can be achieved. 

If the double-balanced phase noise measurement system does not provide 
a noise floor sufficient for measuring a high-quality source. frequency 
multiplier chains can be used if their inherent noise is 10-20 dB below the 
measurement system noise. In frequency multiplication the noise increases 
according to 


10 log(final frequency/original frequency). (73) * 
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Fic. 14 Data plots of the automated phase-noise measurement system: (a) a high quality 
S-MHz quartz oscillator, (b) combined nose of two H.P. 862A synthesizers (subtract 3 4B 
for a single unit), 


© See Appendix Note # 32 
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The following equation is used to correct for noise-floor contribution 
P,,, in dBc/Hz, if desired or necessary: 


LU fNeorrected) = —L(f) + toro” ad (74) 

Pas 
The correction for noise-floor contribution can also be obtained by using 
the measurement of S,,( / ) of Eq. (57). Measurement of S,,( / ) of the oscillator 
plus floor is obtained, then S,,{ /) is obtained for the noise floor only. Then, 


Su] = Sai] ~ Sats] 75) 
leor ose + nf) at 

Figure {4a shows a phase noise plot of a very high-quality ($-MHz) 
quartz oscillator, measured by the two-oscillator technique. The sharp 
peaks below 1000 Hz represent the 60-Hz line frequency of the power supply 
and its harmonics and are not part of the oscillator phase noise. Figure 14b 
shows measurements to 0.02 Hz of the carrier at a frequency of 20 MHz. 


IV. Single-Oscillator Phase-Noise Measurement Systems and * 


Techniques 


The phase-noise measurements of a single-oscillator are based on the 
measurement of frequency fluctuations using discriminator techniques. The 
practical discriminator acts as a filter with finite bandwidth that suppresses 
the carrier and the sidebands on both sides of the carrier. The ideal carrier- 
suppression filter would provide infinite attentuation of the carrier and 
zero attenutation of all other frequencies. The effective Q of the practical 
discriminator determines how much the signals are attenuated. 

Frequency discrimination at very high frequencies (VHF) has been ob- 
tained using slope detectors and ratio detectors, by use of lumped circuit 
elements of inductance and capacitance. At ultrahigh frequencies (UHF) 
between the VHF and microwave regions, measurements can be performed 
by beating, or heterodyning, the UHF signal with a local oscillator to obtain 
a VHF signal that is analyzed with a discriminator in the VHF frequency 
range. Those techniques provide a means for rejecting residual amplitude- 
modulated (AM) noise on the signal under test. The VHF discriminators 
usually employ a limiter or ratio detector. 

Ashley et al. (1968) and Ondria (1968) have discussed the microwave 
cavity discriminator that rejects AM noise, suppresses the carrier so that the 
input level can be increased, and provides a high discriminated output to 
improve the signal-to-noise floor ratio. The delay line used as an FM dis- 
criminator has been discussed by Tykulsky (1966), Halford (1975), and 


3 See Append Nowe #6 
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Fic. 15 Single-oscillator phase-nowse measurement techniques: (a) cavity discriminator 
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Ashley er al. (1968). Ashley er al. (1968) proposed the reflective-type delay- 
line discriminator shown in Fig. 15b. The cavity can also be used to replace 
delay line. The one-way delay line shown in Fig. 15c is implemented in the 
TRW measurement systems. The theory and applications set forth in this 
section are based on a system of this particular type. 


A. THE DeLay Line as AN FM DiscRIMINATOR 


1. The Single-Oscillator Measurement System 


The single-oscillator signal is split into two channels in the system shown 
in Fig. 15. One channel is called the nondelay or reference channel. It 1s also 
referred to as the local-oscillator (LO) channel because the signal in this 
channel drives the mixer at the prescribed impedance level (the usual LO 
drive). The signal in the second channel arrives at the mixer through a delay 
line. The two signals are adjusted for phase quadrature with the phase 
shifter, and the output of the mixer 1s a fluctuating voltage, analogous to the 
frequency fluctuations of the source, centered on approximately zero dc 
volts. 

The delay line yields a phase shift by the tome the signal arrives at the 
balanced mixer The phase shift depends on the instantaneous frequency of 


TN-219 


7. PHASE NOISE AND AM NOISE MEASUREMENTS 269 


the signal. The presence of frequency modulation (FM) on the signal gives 
rise to differential phase modulation (PM) at the output of the differential 
delay and its associated (nondelay) reference line. This relationship is linear 
if the delay ty is nondispersive. This is the property that allows the delay line 
to be used as an FM discriminator. In general, the conversion factors are a 
function of the delay (ty) and the Fourier frequency / but not of the carrier 
frequency, 

The differential phase shift of the nominal frequency v, caused by the delay 
line is 


Ad = 2avo ty, (76) 


where rt, is the time delay. 
The phase fluctuations at the mixer are related to the frequency fluctuations 
(at the rate f) by 


60 = Inty dw f). (77) 
The spectral density relationships are 


Sse!) = (2x4)? Syl SY) (78) 
user lose 
and 
Sul f) =f? Sol /)- (79) 
Then, 
Sul) = rftal? Sul A. (80) 
\dtem 


where the subscript dim indicates delay-line method. From Eq. (56), the 
spectral density of phase for the two-oscillator technique, in radians squared 
per hertz, is 


, i,j? 
because 

(gig)? = B(Upms)? = 4 Vg)? = SL2(C smn)? 
and 

LP) = ASaCL WV gup)?) = (Ot ana)? HM Verna) B (82) 
per hertz. 
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The sensitivity (noise floor) of the two-oscillator measurement system 
includes the thermal and shot noise of the mixer and the noise of the base- 
band preamplifier (referred to its input). This noise floor is measured with 
the oscillator under test inoperative. The measurement system sensitivity of 
the two-oscillator system, on a per hertz density basis (dBc Hz) 1s 


LU np = 10 log ASe.7 (Vp). (83) 


where dv, 1s the rms noise voltage measured in a one-hertz bandwidth. 

The two-oscillator system therefore yields the output noise from both 
oscillators. If the reference oscillator is superior in performance, as assumed 
in the previous discussions, then one obtains a direct measure of the noise 
characteristics of the oscillator under test. If the reference and test oscillators 
are the same type, a useful approximation is to assume (hat the measured 
noise power is twice thal associated with one noisy oscillator, This approxi- 
mation is in error by no more than 3 dB for the noisier oscillator. Substituting 
in Eq. (80) and using the relauonships in Eq. (56), we have, per hertz, 


LU = (Seemed? (Veep) WARS t9)* (84) 


\stm 
Examination of this equation reveals the following. 


(1) The term in the brackets represents the two-oscillator response, 
Note that this term represents the noise floor of the two-oscillator method. 
Therefore. adoption of the delay-line method results im a higher noise by the 
factor (22/14)? when compared with the two-oscillator measurement method. 
The sensitivity (norse floor) for delay lines with different values of time delay 
are illustrated in Fig. 17 

(2) Equation (84) also indicates that the measured value of #(f) is 
periodic in = 2nf. This 1s shown in Fig. 21. The first null in the responses 
1s at the Fourver frequency f = 1)tg. The periodicity indicates that the cali- 
bration range of the discriminator 1s limited and that valid measurements 
occur only in the indicated range. as verified by the discriminator slope shown 
in Fig. 16 (See Fig. 23.) 

(3) The maximum value of (2nft,)? can be greater than unity (1t 1s 4 at 
f = 1 2ty). This 6-dB advantage ts utilized in the noise-floor measurement 
However, it 1s beyond the valid calibration range of the delay-line system. 
The 6-dB advantage is offset by the line attenuation at microwave frequencies, 
as discussed by Halford (1975). 


The delay-line discriminator system has been analyzed in terms of a power- 
limited system (a particular idealized system in which the choice of power 
oscillator voltage, the attenuator of the delay line, and the conversion loss 
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of the mixer are limited by the capability of the mixer) by Tykulsky (1966), 
Halford (1975), and Ashley et al. (1977). For this particular case, Eq. (83) 
indicates that an increase in the length of the delay line (to increase t, for 
decorrelation of Fourier frequencies closer to the carrier) results in an 
increase in attenuation of the line, which causes a corresponding decrease 
in Vay. The optimum length occurs where rt, is such that the decrease in 
Vir is approximately compensated by the increase in (2n/t,), ic. where 


d 2nft, 
Fe Veo 0. (85) 

This condition occurs where the attenuation of the delay line is | Np 
(8.686 dB). However, when the system is not power limited, the attenuation 
of the delay line is not limited, because the input power to the delay line can 
be adjusted to maintain V,,, at the desired value. The optimum delay-line 
length is determined at a particular selectable frequency. However, since 
the attenuation varies slowly (approximately proportional to the square root 
of frequency), this characteristic allows near-optimum operation over a 
considerable frequency range without appreciable degradation in the 
measurements. 

A practical view of the time delay (t,) and Fourier-frequency functional 
relationship can be obtained by reviewing the basic concepts of the dual- 
channel time-delay measurement system discussed by Lance (1964). If the 
differential delay between the two channels is zero, there is no phase differ- 
ence at the detector output when a swept-frequency cw signal is applied 
to the system. Figure 16 shows the detected output interference display when 
a swept-frequency cw signal (zero to 4 MHz) is applied to a system that has 
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Fic. 16 Swept-frequency interference display at the output of a dual-channel system 
with a differential delay of $00 asec. 
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a differential delay of S00 nsec between the two channels. The signal ampli- 
tudes are assumed to be almost equal, thus producing the familiar voltage- 
standing-wave pattern or interference display. Because this 1s a two-channel 
system, there is a null every 360°, as shown. 


2. System Sensitivity (Noise Floor) When Using the 
Differential Delay-Line Technique 


Halford (1975) has shown that the sensitivity (noise floor) of the single- 
oscillator differential delay-line technique is reduced relative to the two- 
oscillator techniques. The sensitivity is modified by the factor 


Sq = 2(1 — cos 2nft,). (86) 
For wt, = 2ndt, € 1 a good approximation is 
S} = 1 — cos 2afty) = (wte)*{1 — (wte)”) = (2nfta?? = 6, (87) 


where @ is the phase delay of the differential delay line evaluated at the 
frequency f. Figure 17 shows the relative sensitivity (noise floor) of the two- 
oscillator technique and the single-oscillator technique with different 
delay-line lengths. The f~? slope is noted at Fourier frequencies beyond 
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Fic. 17 Relative sensitsvity (nowe floor) of single-oscillator and two-oscillator phase- 
noise measurement systems. 
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about | kHz. For Fourier frequencies closer to the carrier, the slope is f ~>. 
ie. the sum of the f ~? slope of Eq. (87) and the f~' flicker noise. 

Phase-locked sources have phase-noise characteristics that cannot be 
measured at close-in Fourier frequencies using this basic system. The 
relative sensitivity of the system can be improved by using a dual (two- 
channel) delay-line system and performing cross-spectrum analysis, which 
will be presented in this chapter. 

Labaar (1982) developed the delay-line rf bridge configuration shown in 
Fig. 18. At microwave frequencies where a high-gain amplifier 1s available, 
suppression of the carrier by the rf bridge allows amplification of the noise 
going into the mixer. A relative sensitivity improvement of 35 dB has been 
obtained without difficulty. The limitations of the technique depend on the 
available rf power and the carrier suppression by the bridge. Naturally, if 
the rf input to the bridge is high one must use the technique with adequate 
precautions to prevent mixer damage that can occur by an accidental bridge 
unbalance. Labaar (1982) indicated the added advantage of using the rf 
bridge carrier-suppression technique when attempting to measure phase 
noise close to the carrier when AM noise is present. Figure 19 shows the 
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Fic. 18 Carrier suppression using an cf bridge to increase relative sensitivity. (Courtesy 
Instrument Society of Amenca.) 
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Fic. 19 Phase detector output (AM-PM crossover): , delay time 


mixer output for phase (PM) and amplitude (AM) noise in the single- 
oscillator delay-line FM discriminator system. It is noted that the phase 
noise and AM noise intersect and that the AM will therefore limit the mea- 
surement accuracy near the carner. Even though AM noise is much lower 
than phase noise in most sources, and even though the AM is normally 
suppressed about 20 dB, there is still AM at the mixer output. This output 
is AM leakage and is caused by the finite isolation between the mixer ports. 
The two-oscillator technique does not experience this problem to this 
extent because the phase noise and AM noise maintain their relative rela- 
uonships at the mixer output independent of the offset frequency from the 
carrier. 


B. CALIBRATION AND MEASUREMENTS USING THE DELAY 
Line 4s AN FM DiscriMINaTOR 


The block diagram of a practical single-oscillator phase noise measure- 
ment system is shown in Fig. 20. The signals in the delay-line channel of the 
system experience the one-way delay of the line, With adequate source 
power, the system is not limited to the optimum | Np (8.686 dB) previously 
discussed for a power-limited system. Measurements are performed using 
the following operational procedures. 


(1) Measure the tracking spectrum analyzer IF bandwidths as set forth 
in Section IIL.C.1. 

(2) Establish the system power levels (Section IV.B.1). 

(3) Establish the discriminator calibration factor (Section 1V.B.2). 

(4) Measure and plot the oscillator characteristics in the automatic 
system used (Section 1V_B.3). 

(S) Measure the system noise floor (sensitivity) (Section IV.B.4). 
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Fic 20 Single-oxcillator phase norse measurement system using the delay line as an 
FM discriminator. (From Lance et a/., 19778.) 


1, System Power Levels 


The system power levels are set using attenuators, as shown in Fig. 20. 
Because the characteristic impedance of attenuator No, 4 is 50 Q, mismatch 
errors will occur if the mixer output impedance is not 50 Q. As previously 
discussed, the mixer drive levels are set so that the mixer output signal, as 
observed during calibration, ts sinusoidal. This has been accomplished in 
TRW systems with a reference (LO) signal level of 10 dBm and a mixer 
input level of about 0 dBm from the delay line. 

A power amplifier can be used to increase the source signal to the measure- 
ment system. This amplifier must not contribute appreciable additional 
noise to the signal. 


2. Discriminator Calibration 


The discriminator characteristics are measured as a function of frequency 
and voltage. The hertz-per-volt sensitivity of the discriminator is defined 
as the calibration factor (CF), The calibration process involves measuring 
the effects of intentional modulation of the source (carrier) frequency. A 
known modulation index must be obtained to calculate the calibration 
factors of the discriminator. The modulation index is obtained by using 
amplitude modulation to establish the carrier-to-sideband ratio when there 
is considerable instability of the source or when the source cannot be fre- 
quency modulated. 
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Itis convenient to consider the system equations and calibration techniques 
in terms of frequency modulation of stable sources. If the source to be 
measured cannot be frequency modulated, it must be replaced, during the 
calibration process, with a modulatable source. The calibration process 
will be described using a modulatable source and a 20-kHz modulation 
frequency. However, other modulation frequencies can be used. The cali- 
bration factor of this type discriminator has been found to be constant over 
the usable Fourter frequency range, within the resolution of the measuring 
technique. The calibration factor of the discriminator is established after the 
system power levels have been set with the unit under test as the source. 

The discriminator calibration procedures are as follows. 


(1) Set attenuator No. 4 (Fig. 20) to 50 dB. 

(2) Replace the oscillator under test with a signal generator or oscillator 
that can be frequency modulated. The power output and operating frequency 
of the generator must be set to the same precise frequency and amplitude 
values that the oscillator under test will present to the system during the mea- 


“surement process. 


(3) Select a modulation frequency of 20 kHz and increase the modulation 
until the carrier is reduced to the first Bessel null, as indicated on the spectrum 
analyzer connected to coupler No. |. This establishes a modulation index 
(m = 2.405), 

(4) Adjust the phase shifter for zero volts dc at the output of the mixer, 
as indicated on the oscilloscope connected as shown in Fig. 20. This estab- 
lishes the quadrature condition for the two inputs to the mixer. This quadrature 
condition 1s continuously monitored and is adjusted if necessary. 

{5) Tune the tracking spectrum analyzer to the modulation frequency 
of 20 kHz. The power reading at this frequency is recorded in the program 
and 1s corrected for the 50-dB setting of attenuator No. 4. which will be set 
to zero decibel indication during the automated measurements. 


P(dBm) = (—dBm power reading) + 50 dB (88) 
This power level is converted to the equivalent rms voltage that the spectrum 


analyzer would have read if the total signal had been applied 
Vv, 1077°/1000 + R. (89) 


rms = VJ 

(6) The discriminator calibration factor can now be calculated because 
this power in dBm can be converted to the corresponding rms voltage using 
the following equation: 


Ves = /(10" *°/1000) x R, (90) 


where R = 50 Qin this system. 
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(7) The discriminator calibration factor ts calculated in hertz per volt as 
CF = ify 2Vemy = 2405 fy’ 2 Vem ) 


The modulation index m for the first Bessel null as used in this technique 
is 2.405, The modulation frequency 1s /.. 


3. Measurement and Data Plotting 


After the discriminator 1s calibrated, the modulated signal source is re- 
placed with the frequency source to be measured. Quadrature of the signals 
into the mixer is reestablished, attenuator No. 4 (Fig. 20) is set to 0 dB, and 
the measurement process can begin. 

The measurements, calculations, and data plotting are completely auto- 
mated. The calculator program selects the Fourier frequency, performs 
autoranging, and sets the bandwidth, and measurements of Fourier frequency 
power are performed by the tracking spectrum analyzer. Each Fourier 
frequency noise-power reading P, (dBm) is converted to the corresponding 
rms voltage by 

= 1077 9771000 x R. (92) 


Clem =v 


The rms frequency fluctuations are calculated as 
Veen = Views * CF. (93) 


The spectral density of frequency fluctuations in hertz squared per hertz is 
calculated as 


SiL) = (OVemng)?/B, (94) 


where B is the measured IF noise-power bandwidth of the spectrum analyzer. 
The spectral density of phase fluctuations in radians squared per hertz is 
calculated as 


Srl) = Sul PS? (95) 


The NBS-designated spectral density in decibels (carrier) per hertz is cal- 
culated as 


L( fay = 10 log $S,,(f). (96) 


Spectral density is plotted in real time in our program. However. the data 
can be stored and the desired spectral density can be plotted in other forms. 
Integrated phase noise can be obtained as desired. 
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4. Noise Floor Measurements 


The relative sensitivity (noise floor) of the single-oscillator measurement 
system 1s measured as shown in Fig. 12a for the two-oscillator technique. 
The delay line must be removed and equal channel lengths constructed, 
as in Fig. (12a). The same power levels used in the origina! calibration and 
measurements are reestablished, and the noise floor is measured at specific 
Fourier frequencies, using the same calibration-measurement technique, 
or by repeating the automated measurement sequence. 

A correction for the noise floor requires a measurement of the rms voltage 
of the oscillator (tj...) and a measurement of the noise floor rms voltage 
(Uzeme)- These voltages are used in the following equation to obtain the 
corrected value: 


Cems = yf tren)? — Crem) (97) 


The value tym, is then used in the calculation of frequency fluctuations. 
If adequate memory is available, each value of v,,—, can be stored and used 
after the other set of measurements are performed at the same Fourier 
frequencies. 

The following technique was developed by Labaar (1982). Carrier sup- 
pression 1s obtained using the rf bridge illustrated in Fig. 18. One can easily 
improve sensitivity more than 40 dB. At 2.0 and 3.0 GHz 70-dB carrier 
suppression was realized. In general, the improvement in sensitivity will 
depend on the availability of an amplifier or adequate input power. 

Figure 21 shows the different noise floors in a delay-line bridge discrimi- 
nator. It is good measurement discipline to always determine these norse 
floors; also, the measurements, displayed in Fig. 21, give a quick under- 
standing of the physical process involved. The first trace 1s obtained by term- 
inating the input of the baseband spectrum analyzer. The measured output 
noise power is then a direct measure of the spectrum analyzer’s noise figure 
(NF), The input noise is thermal noise and is usually indicated by “KTB.” 
which is short for “the thermal noise power at absolute temperature of T 
degrees Kelvin) per one hertz bandwidth (B), This KTB number is, at 18°C, 
about — 174 dBm, Hz 

Figure 21a shows that trace number | for frequencies above about 1 kHz is 
level with a value of about —150dBm = —(174-24) dBm, which means that 
the spectrum analyzer has an NF of 24 dB. At 20 Hz the NF has gone up to 
about 48 dB. To improve the NF. a low-noise (NF, 2B), low-frequency 
(10 Hz-10 MHz) amplifier 1s inserted as a preamplifier. Terminating its 
input now results in trace number 2. At the high frequency end, the measured 
power goes up by about 12-13 dB, and the amplifiers gain is 34 dB. This 
means that the NF is improved by 34 ~ 12-13 = 21-22 dB, which is an 
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Fic. 21. (a) Norse contnbution analysis. (b) phase noise test setup using 4 delay-line rf 
bridge discriminator (cf = 28 GHz, ©. termination points. NF, noise figure: LF. low frequency 
(From Seal and Lance. 1981) 


NF = 2-3 dB as expected, i.¢., the first stage noise predominates. The low- 
frequency end at 20 Hz gives an NF of 26 dB, which overall is quite an im- 
provement. 

In trace number 3 the mixer is included with it’s rf (signal) port terminated. 
It is clear from this trace that certainly up to 100 kHz, the noise generated 
by the mixer diodes being “ pumped” by the LO signal dominates. This case 
represents the “classic” delay-line discriminator. The last trace (number 4) 
includes the low-noise, high-gain rf amplifier that can be used because the 
carrier is suppressed in the delay-line rf bridge discriminator, in contrast 
to the classic delay-line discriminator case. This trace shows that from | kHz 
on up the measured output power is flat, representing a 2-3-dB NF. 

At about 20-40 Hz, trace numbers 3 and 4 begin nearing their cross- 
over floor. In this particular case, which is discussed in full by Labaar (1982), 
the measurement systems noise floor (resolution) has been improved by 
40 dB. 

Figure 22 shows plots of phase noise as measured at two frequencies 
using delay lines of different lengths. The delay line used measure at 600 MHz 
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Fic 22 Phase nove of 600-MHz oscillator multiplied to 24 GHz (From Lance et a/., 


‘was about S00 nsec long, as noted by the first null, 1.e., the reciprocal of the 
Fourter frequency of 2 MHz 1s the approximate differential time delay 
Note that a shorter delay line (approximately 250 nsec differential) is used 
to measure the higher frequency because the delay-line discriminator 
calibration ts valid only to a Fourier frequency at approximately 35°, of 
the Fourier frequency at which the first null occurs. if a linear transfer 
function is assumed 
The actual transfer function of a delay-line discriminator (classic and rf 
bridge types) 1s sinusoidal, as shown in Fig, 23a. The baseband spectrum 
analyzer measures power in a finite bandwidth, and as a consequence 1t is 
possible to measure through a transfer-function null if the noise power does 
not change substantially over a spectrum-analyzer bandwidth. The following 
power relations then hold 
ere du 2 Pia) pore? 


Pref) = dw { Plo’) dw’ = 


Jude 2 So Ju-su2 


doy’ = P(w). (98) 
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Fic. 23. Transfer functions for a delay-hne rf bridge discriminator, (a) actual, (b) 
approximate (linear) and “correct " (sinusoidal), Phase nose: H.P. 8672A at 24 GHz 


Figure 23b shows the results using a linear approximation and the “cor- 
rect” transfer function for a delay-line rf bridge discriminator. The correct 
transfer function breaks down close to the null because the signal level 
drops below the system's noise floor, as explained by Labaar (1982). 

Using the sinusoidal transfer function in the calculator software gives 
correct results barring frequency intervals of 5 to 10 spectrum analyzer's 
bandwidths (10 x 30 = 300 kHz) centered at the transfer function nulls. 
These particular data were selected to illustrate the characteristics of the 
system. Recall that one can easily make the noise floor 40 dB lower using 
the rf bridge shown in Fig. 18, 


C. Duat Detay-Line DiscriMINATOR 
1. Phase Noise Measurements 


The dual delay-line discriminator is shown in Fig. 24, This system was 
suggested by Halford (1975) as a technique for lowering the noise floor 
of the delay-line phase noise measurement system. The system consists of 
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Fic. 24 A dual delay-line phase nore measurement system, (Courtesy Instrument Society 
of Amenca.) 


two differential delay-lne systems. The single-oscillator signal is applied 
to both systems and cross-spectrum analysis is performed on the signal 
output from the two delay-line systems. Signal processing ts performed with 
the Hewlett-Packard 5420A digital signal analyzer. The cross spectrum is 
obtained by taking the product of the Fourier transform of one signal and 
the complex conjugate of the Fourier transform of a second signal. It is 
a phase-sensitive characteristic resulting in a complex product that serves 
as a measurement of the relative phase of two signals. Cross spectrum gives 
a phase- and amplitude-sensitive measurement directly By performing 
the product S34 /)» Sx(f)*.a certain signal-to-noise enhancementis achieved. 
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The low-noise amplifiers preceding the digital signal analyzer are used 
when performing measurements at Fourier frequencies from | Hz to 25 kHz. 
The amplifiers are not used when performing measurements below the 
Fourier frequency of | Hz. 


2. Calibrating the Dual Delay-Line System 


Each delay line in the system is calibrated separately following the same 
basic procedure set forth in Section IV.B. The Hewlett-Packard 5420 
measures the one-sided spectral density of frequency fluctuations in hertz 
squared per hertz. The spectral density of phase fluctuation in radians 
squared per hertz can be calculated as 


Sil 1) = SH DUS?, (99) 
and 
2S) = Sal S27, (100) 


per hertz. The Hewlett-Packard 5420 measurement of S,,( f) in Hz?/Hz must, 
therefore, be corrected by 12/7, However, the f correction must be entered 
in terms of radian frequency (w = 2nf). This conversion is accomplished by 


PUP) = Sol fKU27M4n7 407) = (27S, No? Cy) 
per hertz since Eq. (100) can be stated in the following terms: 
(2n?S, (fan f? 


Signal-to-noise enhancement greater than 20 dB has been obtained using 
the dual-channel delay-line system. 


D, MILLiMeTER-WaAvE PHAse-Noise MEASUREMENTS 
1, Spectral Density of Phase Fluctuations 


The delay line used as an FM discriminator is based. in principle, on a 
nondispersive delay line. However, a waveguide can be used as the delay 
line because the Fourier frequency range of interest is a small percentage 
of the operating bandwidth (seldom over 100 MHz), and the dispersion can 
be considered negligible. 

The calibration and measurement are performed as set forth in Section 
IV.B. The modulation index m is usually established using the carrier-to- 
sideband ratio that uses amplitude modulation because millimeter sources 
are either unstable or cannot be modulated. The two approaches to measure- 
ments at millimeter frequencies are shown in Figs. 25 and 26. Figure 25 
shows the direct measurement using a waveguide delay line. This system 
offers improved sensitivity if adequate input power is available. The rf bridge 
and delay-line portion of the system differs from Fig. 18 because pre- and 
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Fig 28 Millimeter-wave phase noise measurements using 2 waveguide delay line (From 
Seal and Lance, 1981} 


post-bridge amplifiers with appropriate gain are not available, so the sensi- 
tyity can equal the amount of carrier suppression. 

Figure 26 shows the use of a harmonic mixer to downconvert to the 
convenient lower frequency where post-bridge amplifiers are available. 
The relatively low sensitivity to frequency drift that is characteristic of delay- 
line discriminators becomes an advantage here. A separate calibration 
generator ts required, as shown in Fig. 25, and a power meter ts used to assure 
proper power levels during the calibration process, 


2. Spectra DENsITY OF AMPLITUDE FLUCTUATIONS 


AM noise measurements require equal electrical length in the two channels 
that supply the signals to the mixer. The delay line must be replaced with the 
necessary length of transmission line to establish the equal-length condition 
when the systems shown in Figs. 25 and 26 are used. The AM noise measure- 
ment system is calibrated and the noise measurements are performed directly 
in units of power for a direct measurement of of) in dBc/Hz. mr f) 1s the 
spectral density of one modulation sideband divided by the total signal 
power at a Fourier frequency difference f from the signal's average frequency 
Vo. The system calibration establishes the detection characteristics in terms 
of total power output at the IF port of the mixer (detector). 
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Fic. 26 A millimeter-wave hybrid phase noise measurement system that produces IF 
frequency and uses a delay-line discriminator at {F frequency. (From Seal and Lance, 1981.) 


The AM noise measurements are performed according to the following. 


(1) A known AM modulation (carrier-sideband ratio) must be estab- 
lished to calibrate this detector in terms of total power output at the IF port. 
The modulation must be low enough so that the sidebands are at least 
20 dB below the carrier. This is to keep the total added power due to the 
modulation small enough to cause an insignificant change in the detector 
characteristics. 

(2) The rf power levels are adjusted for levels of approximately 10 dBm 
at the reference port and 0 dBm at the test port of the mixer. 
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(3) Approximately 40 dB ts set in the precision IF attenuator. The system 
1s adjusted for an out-of-phase quadrature condition 

(4) The modulation frequency and power level are measured by the 
automatic baseband spectrum analyzer. The total carrier-power reference 
level is measured power, plus the carrier-sideband modulation ratio, plus 
the IF attenuator setting. 

(5) The AM modulation ts removed. the IF attenuator set to 0 dB, and 
the system re-checked to verify the out-of-phase quadrature (maximum de 
output from the mixer IF port). Notse (V,) is measured at the selected Fourier 
frequencies, A direct calculation of w#( f) in dBc/Hz 1s 


wf) = [(modulation power (dBm) + carrier-sideband ratio (dB) 
+ IF attenuation (dB) — noise power (dBm) + 2.5 dB 
— 10 log(BW)). (102) 


Figure 27 illustrates the measurements of AM and phase noise of two 
GUNN oscillators that were offset in frequency by | GHz. The measurements 
were performed using the coaxial delay-line system 
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Fic 27 Phase nowe and AM novse of 40- and 41-GHz Guan oscillators (From Seal 
and Lance. 1981) 
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V. Conclusion 


The fundamentals and techniques for measurement of phase noise have 
been set forth for two basic systems. The two-oscillator technique provides 
the capability for measuring high-performance cw sources. The system 
sensitivity ts superior to the single-oscillator technique for measuring phase 
noise very close to the carrier. 

High-stability sources such as those used in frequency standards applica- 
tions can be measured without using phase-locked loops. However, most 
microwave sources exhibit frequency instability that requires phase-locked 
loops to maintain the necessary quadrature conditions. The characteristics 
of the phase-locked loops must be evaluated to obtain the source phase 
noise characteristics. Also, in principle, one must have three sources at the 
same frequency to characterize a given source. If three sources are not avail- 
able, one must assume that either one source 1s superior in performance or 
that they have equal phase noise contributions. 

The single-oscillator technique employing the delay line as an FM dis- 
criminator has adequate sensitivity for measuring most microwave sources. 
The economic advantages of using this system include the fact that only 
‘one source 1s required, phase-locked loops are not required, system configur- 
ation is relatively inexpensive, and the system is inherently insensitive to 
oscillator frequency drift. 

The single-oscillator technique using the delay-line disctiminator can 
be adapted to measure the phase noise of pulsed sources. Pulsed sources 
have been measured at 94 GHz by F. Labaar at TRW, Redondo Beach, 
Califorma. 
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Summary 


A fully automated measurement system has 
been developed that combines many properties 
Previously realized with separate techniques 
This system is an extension of the dua) mixer 
time difference technique, and maintains its 
important features: zero dead time, absolute 
phase difference measurement, very high preci- 
sion, the ability to measure oscillators of 
equal frequency and tne ability to make measure- 
ments at the time of tne operator's choice.” For 
one set of design parameters, the theoretical 
resolution is 0.2 ps, the measurement noise is 2 
ps rms and measurements may be made witnin 0.15 
of any selected time The dual mixer technique 
has been extended by adding scalers which remove 
the cycle ambiguity experienced in previous 
realizations. In this respect, the system 
functions like a divider plus clock, storing the 
epoch of each device under test in hardware. 


The automation jis based onthe ANSI/IEEE- 
$83 (CAMAC) interface standard.“ Each measure- 
ment channel consists of a mixer, zero-crossing 
detector, scaler and time interval counter. 
Four channels fit in 3 double width CAMAC module 
which in turn is installed in a standard CAMAC 
crate, Controliers are available to interface 
with a wide variety of computers as well as any 
TEEE-488 compatible device. Two systems have 
been in operation for several months. One 
operates 2 hours a day, taking data from 15 
clocks for the NBS time scale, and the other is 
used for short duration laboratory experiments 


Seview of the Qual Mixer 
Tine Difference Technique 


It is advantageous to measure time directly 
rather than time fluctuations, frequency or 
frequency fluctuationns These measurements 
constitute a hierarchy in which the subsequently 
listed quantities may always be calculated from 
the previous ones. However, the reverse is not 
true when there are gaps in the seasurements. 
In the past, frequency was usually not derived 
from time measurements for short sample tines 
because time interva! measurements could not be 
performes with adequate precisian The dual 


a4 


mixer technique, illustrated in Figure 1, made 
it possible to realize the precision of the beat 
frequency technique in time interval measure 
ments, 


The signals from two oscillators (clocks) are 
applied to two ports of a pair of double balan- 
ced mixers, Another signal synthesized from one 
of the oscillators is applied to the remaining 
two ports of tne mixer pair, The input signals 
may be represented in the usual fashion 

V(t) = Vyq sin Lénvyot + 0)(t)], 

Volt) = Voq sin L2nvoot * o,(t)] and 

V(t) = Ve, cos Lémv. ot + 9,(t)] 


where vo. = vig(1-1/R) and R is a constant 
Usually &Qited the heterodyne factor. 


The low passed outputs of the two mixers 
are 


1 = Yer Sin Ce,(t) ~@,(t)] and 

Yao = Yeon Sin [o2(t)-#,(t)] where 

@(t) = anygt + o(t). 
The time interval counter starts at time ty when 
Va, crosses zero in the positive direction and 
sthps at time t,, the time of the very next 
positive zero crossing of Yao: Thus 

Oy(ty) > O.(ty) = Mm and 

Oykty) ~ (ty) = 2Nn where 
Nand M are integers. 
Subtracting the two equations in order to com 
pare the phases of oscillators 1 and 2, one 
obtains 

Pol ty )-o (ty) at (ty rb (ty )e2(N-M a. 


The phase of an oscillator at time t, may 
be written in terms of its phase at t,, and it 
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average frequency over the interval ty < ty 
(ty) = O(ty) + 2nCU(tyity)](ty-ty) and 


when we apply this equation to both % and es 
we find 


OC ty)-#4(ty) = 20N-H)A 
~2nCga(tyity)](tyo ty) 
where vay = vo7v.. 


Since M and N are not measureable with the 
equipment in Figure 1, the dual mixer technique 
has heretofore only been used to measure the 
phase difference between two oscillators modulo 
2n. We denote the period of the time interval 
Counter time base by t. and the number of counts 
recorded in a measurement by P. Then the phase 
difference between the two oscillators is given 
by 


(90 ty)-@, (ty) Jmod 2m = ~2nCOgo( ty; ty) It P 


Figure 2 {llustrates the output of the 
measurement system over a period of time. If a 
measurement begins and ends without the time 
interval counter making a transition between 
zero and its maximum value, e.g., t, < ty <t< 
t,, then the phase difference can Be catculated 
fRim the data. If t, < ty < ty < ty < th, then 
the data must be cofrectéh vy 2n Uo cafculate 
the phase difference. Experience has shown that 
there are many measurement situations for which 
the number of transitions of the time interval 
counter which occur between ty and ty cannot be 
known. For this reason, a modificati¥n nas been 
developed which removes the ambiguity by measur- 
ing 4 and N. 


Extended Dual Mixer Time 
Difference Measurement Technique 


In order to configure the system to acquire 
complete phase information, two scalers are 
added to count tne zero crossings of each mixer. 
Figure 3 is the block diagram of a two channe) 
system, It is constructed from identical cir- 
cuit modules and therefore contains an unused 
time interval counter. However, this design 
permits very straightforward and inexpensive 
extension to the comparison of an arbitrarily 
large number of oscillators with no need for 
switching any signals. 


The counter outputs are combined to form 
the phase difference between oscillators. 


y(ty)-%y (ty) = 2INS-M a) + 2¢NM IR 
-Onbing a tysty) 1e,P 
The first term is a constant which represents 
the choice of the time origin and can be ig- 


nored, The last two terms and their sum are 
plotted in Figure 4. 
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The average beat frequency Us, (ty;ty) 
cannot known tly. However, 52, Bay 
estimated with sufficient precision from the 
previous pair of measurements designated ' and 
» The average frequency is approximately 


Vagal tyity) & (NNN! )/TROM=M! )/vg 9 + tT (PY=P')] 


provided that it changes sufficiently slowly 
compared to the interval tytn: A typical value 
for this error will be giveh in the following 
section. 


Hardware Implementation 


All measurement channels consist of a 
mixer, zero-crossing detector, scaler and time 
interval counter. Four such circuits can be 
built in a double width CAMAC module. The 
system is easily expanded to compare many oscil- 
lators and a complete system for making phase 
comparisons among four clocks is shown in Figure 
5. We have chosen parameters which are reason- 
able for comparing state-of-the-art atomic stan- 
dards. Thus, the synthesizer is offset 10Hz 
below oscillator # 1 and R = 5 x 10°. The 
outputs from both mixers are approximately 10Hz. 
The noise bandwidth is 100 Hz. The time inter- 
val counter is twice the frequency of oscillator 
#1 or approximately, 10 MHz. The quantization 
error is 1/28 = 10° cycle or 0.2ps which is a 
factor of ten smaller than the measurement 
noise, As stated earlier, an error will result 
from frequency changes which violate the con- 


stancy assumption used to estimate v,,. A 
change in v, by 10 during the interna be- 
tween two measurements will result in a time 


deviation error of l0ps. Thus, one must make 
more closely spaced measurements for oscillators 
which have large dynamic frequency changes than 
for more stable devices. Two other sources of 
inaccuracy are the sensitivities to the ampli- 
tude and phase of the common oscillator. Figure 
6 shows the measured value of x = 9/2nv, as a 
function of the amplitude of the input Signal 
and the phase of the synthesizer. 


The new measurement system has many desir- 
able features and properties: 


(1) It has very high resolution, limited by the 
internal counters to 0.2 ps and by noise to 
approximately 2 ps 


(2) It has much lower nofse than divider based 
measurement systems. However compromises 
made to achieve low cost, low power, small 
size and autosatic operation degrade the 
performance compared to state-of-the-art 
systems for comparing 2 oscillators. 


(3) The operation is fully automatic. 


(4) NBS has developed a detailed opegating 
manual for the equipment and software. 
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(3) 


(6) 


(7) 


(8) 


(3) 


(10) 


qa) 


a2) 


Ail oscillators in the range of 5 MHz + 5 
Hz may be compared. Other carrier frequen- 
cies such as 1 MHz, 5.115 MHz, 10 MHz and 
10.23 MHz are also usable. However, dif- 
ferent carrier frequencies may not be mixed 
on the same system. The system has been 
successfully tested witn an oscillator oftf- 
set 4.6 riz from nominal SMHz. Measurements 
were made at intervals of 2 hours between 
which the system had to accumulate approx- 
imately 2 x 10°n. The system has also begn 
tested with an oscillator offset 4x 10 “, 
and no errors were detected during a period 
of 40 days. 


All sampling times in the range of 1 second 
to 16 days with a resolution of 0.1 second 
are possibile. Measurements may be made on 
command or in a preprogrammed sequence. 


Measurements are synchronized precisely, 
i.e. at tne picosecond level, with the 
reference clock. They may therefore be 
synchronized with important user system 
events, such as the switching times of a 
FSK or PSK system. 


All oscillators are compared synchronously 
and all measurements are performed within a 
maximum interval of 0.1 second. As a re 
sult, the phase of any oscillator needs to 
be interpolated to the chosen measurement 
time for an interval of 0.1 second maximum, 
This capability, which is not present in 
either single Neterodyne measurement sy- 
stems or switched measurement systems 
eliminates a source of “measurement” error 
which {s generally much larger than the 
noise induced errors. For example, inter- 
polation of the pogge gf a high performance 
Cs clock (c, ~ 10 “°/1t*) over a period of 3 
hours would produce approximately 1.5 ns 
phase uncertainty, To maintain 4 ps accur- 
acy requires measurements simultaneous to 
0.1s. 


There are no phase errors due to the swit- 
ching of rf signals since there is no 
switching anywhere in the analog measure- 
ment system 


No appreciable phase errors are introduced 
when it is necessary to change the refer- 
ence clock since, as shown in Figure §, the 
peak error due to changes in synthesizer 
phase is 20 ps 


The measurement system is capable of nea- 
suring its own phase noise when the same 
signal is applie¢ to two input ports 
Figure 7 shows the phase deviations between 
two such channels over a period of 75,000 
seconds and Figure 8 is the corresponding 
Allan variance plot. Figure 9 shows the 
phase deviatiuns between 2 input channels 
aver a period of 80 day, 


Since the I€£E-523 (CAMAC) interface stan- 
Gard nas been followea for all the custom 
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hardware, the system may be easily inter- 
faced to almost any instrument controller. 
NBS has already tested tne system using a 
large minicomputer, a smal] minicomputer 
and a desk top calculator. Interfaces 
Ddetween IEEE-583 and IEEE-488 controllers 
are available and have been used success- 
fully 


(13) The system is capable of camparing a very 
large number of oscillators at a reasonable 
cost per device. 


There are also disadvantages to this mea- 
surement system. The most important are: 


(1) The complexity of the hardware is greater 
than for some systems. It is possible 
that this will reduce reliability 


(2) A high level of redundancy is difficult to 
achieve. The system design stresses size, 
Power, convenience and cost, resulting in 
an increase in the number of possible 
single point failure mechanisms compared to 
some other techniques, For example, a 
CAMAC power supply failure will result in a 
Joss of data for all devices being measured. 


(3) A substantial committment is required in 
both specialized hardware and software 


(4) If an oscillator under test experiences a 
phase jump which exceeds 1 cycle, the 
measurement system records a jump with 
incorrect absolute magnitude. As a result, 
it may not be applicable to signals which 
are frequency modulated with discontinuous 
phase steps larger than 2n 


Conctusions 


We Nave demonstrated @ new phase measure- 
ment system with very desirable properties: All 
oscillators fn the range of SMH2 + 5Hz may be 
measured directly, The sampling times are only 
restricted by the requirement that they exceed 
one, second. The noise floor is o.(2,1) = 3 x 
10 14/; in short term and the time deviations 
are less than 100 ps. All circuitry is designed 
as modules which allows expansion at modest 
cost. Compatibility with a variety of computers 
js insured through tne use of the [fEE-583 
interface and adapters are available to permit 
use with an IEEE-488 controller, The system 
makes it feasible to make completely automated 
phase measurements at predetermined times on 
large numbers of atomic clocks. [t's own noise 
is one-hundred times less than the state-of-the- 
art in clock performance. It will be used in 
tne near future to make all measurement needed 
to compute NBS atomic time, but ft will alse be 
wery valuable for any laboratory which uses 
three or more atomic clocks 
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Abstract 

We theoretically and expermentally investigate the biases 
and the variances of Fast Founer transform (FFT) spectral es- 
timates with different windows (data tapers) when used to an- 
alyze power-law noise types f°, f7?, f~? and f~*. There is a 
wide body of literature for white noise but virtually no investiga- 
tion of biases and vanances of spectral estimates for power-law 
noise spectra commonly seen in oscillators, amplifiers, mixers, 
etc, Biases (errors) in some cases exceed 30 dB. The expen- 
mental techniques introduced here permit one to analyze the 
performance of virtually any window for any power-law noise 
This makes it possible to determine the level of a particular 
noise type to @ specified statistical accuracy for particular 
window 


I. Introduction 


Fast Fourier transform (FFT) spectrum analyzers are very 
commonly used to estimate the spectral density of noise. These 
instruments often have several different windows (data tapers) 
available for analyzing different types of spectra. For example, 
in some applications spectral resolution is important; in others, 
the precise amplitude of a widely resolved line is important: and 
in still other applications, noise analysis is important, These 
diverse applications require different types of windows 

We theoretically and expenmentally investigate the biases 
and variances of FFT spectral estimates with different windows 
when used to analyze « oumber of common power-law noise 
types. There is a wide body of literature for white noise but vir- 
tually no investigation of these effects for the types of power-law 
noise spectra commonly seen in oscillators, amplifiers, mixers, 
etc. Specifically, we present theoretical results for the biases 
associated with two common windows — the uniform and Han- 
ning windows — when applied to power-law spectra varying 
as f°, f-? and f~*. We then introduce experimental tech- 
niques for accurately determining the biases of any window and 
use them to evaluate the biases of three different windows for 
power-law spectra varying as f?, f-?, f-? and f-*. As an ex- 
ample we find with f~* noise that the uniform window can have 
errors ranging from a few dB to over 30 dB, depending on the 
length of span of the f~* noise. 

We have also theoretically investigated the variances of 
FFT spectral estimates with the uniform and Hanmng windows 
(confidence of the estimates) as a function of the power-law 
noise type and as a function of the amount of data. We in- 
troduce expernmental techniques that make it relatively easy to 
independently determine the variance of the spectral estimate 
for virtually any window on any FFT spectrum analyzer. The 
variance that is realized on a particular instrument depends not 
only on the window but on the specific implementation in both 
hardware and software, We find that the variance of the spec- 
tral density estimates for white noise, f°, is very similar for 
three specific windows available on one instrument and almost 
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identical to that obtained by standard statistical analysis. The 
variances for spectral density estimates of f~* noise are only 
4% higher than that of f° noise for two of the windows stud- 
ied. The third window — the uniform window — does not yield 
usable results for either f~? or f~* noise 

Based on this work it is now possible to determine the 
minimum oumber of samples necessary to determine the level 
of a particular noise type to a specified statistical accuracy as 
function of the window. To our knowledge this was previously 
possible only for white noise — although the traditional results 
‘are generally valid for noise that varied as f~*, where 3 was 
equal to or levs than 4. 


Tl. Spectrum Analyzer Basics 


The spectrum analyzer which was used in the experimen- 
tal work reported here is fairly typical of a oumber of such in- 
struments currently available from various manufacturers. The 
basic measurement process generally consists of taking a string 
of N, = 1024 digital samples of the input wave form, which we 
represent bere by X;, Xz, .... Xv, The basic measurement 
period was 4 ms. This yields a sampling time Ot = 3.90625 us. 
Associated with the FFT of a time senes with .V, data points, 
there are usually (N,/2) + 1 = 513 frequencies 

he Kar 2 80,1,....N0/2 
The fundamental frequency f; is 250 Hz, and the Nyquist fre- 
quency fw, 2 is 128 kHz. Since the spectrum analyzer uses 
an anti-aliasing filter which significantly distorts the high fre 
quency portion of the spectrum, the instrument only displays 
the measured spectrum for the lowest 400 nonzero frequencies, 
namely, fy = 250 Hz, fz = 500 Hz, .... faoo = 100 kHz. 

The exact details of how the spectrum analyzer estimates 
the spectrum for X;, .... Xy, are unfortunately not provided 
in the documentation supplied by the manufacturer, so the fol- 
lowing must be regarded only as a reasonable guess on our part 
as to its operation (see [1] for a good discussion on the basic 
ideas behind a spectrum analyzer; two good general references 
for spectral analysis are (2] and (4|). The sample mean. 


i 
kar Lx, 
7 


is subtracted from each of the samples, and each of these “de- 
meaned” samples is multiplied by a window h, (sometimes called 
‘a data taper) to produce 
Xi) =A (X,-2). 
The spectral estimate, 
Ne 


2 
Sify) = at army . p02 


= 
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is then computed using an FFT algonthm. 

The subscnpt “1” on S\(f,) indicates that this 1s the spec- 
tral esumate formed from the first block of .V, samples, A 
similar spectra] estimate 52( f,) 1s then formed from the second 
block of contiguous data Xw,+1, Xw,+2,---, Xam, bo all, there 
are Ny different spectral estimates from Ny contiguous blocks, 
and the spectrum analyzer averages these together to form 


Pe 
Sih) = 5 Suh) a) 


It is the statistical properties of $(/,) with which we are con- 
cerned in this paper. 

Unfortunately some important aspects of the windows are 
not provided in the documentation for the instrument. One im- 
portant detail is the manner in which the window is normalized. 
There are two common normalizations: 


N, 


¥ [a (X- 2)? = 


and 


Ne 
Tvs (2) 


The first of these is common in engineering applications because 
it ensures that the power in the windowed samples X,*! is the 
same as in the original demeaned samples, the second is equiv- 
alent to the first in expectation and is computationaly more 
convenient, but it can result in small discrepancies in power 
levels. Either normalization affects only the level of the spec- 
tra] estimate and not its shape. 

There are three windows built into the spectrum analyzer 
used here. The first is the uniform (rectangular, default) win- 
dow Al”) = 1//N,. The second is the Hanning data window, 
for which there are several slightly different definitions in the 
literature. In lieu of specific details, we assume the following 
symmetric definition: 


AM =O (1 ~ con MEE O9)) lets 
N, 


ath Barses me: 
here C() is « constant which forces the normalization in Equa- 
tion (2). The third window is a proprietary “flattened peak” 
window, about which little specific information is available (it 
is evidently designed to accurately measure the heights of peaks 
in « spectrum). 


TIl. Expected Value and Bias of Spectral Estimates 
TILA. Theoretical Analysis 


We need to assume a noise model for the X;'s in order 
to determine the statistical properties of $(f,) in Equation (1). 
We consider three different models, each af which is represented 
in terms of a Gaussian white noise process ¢, with mean zero 
and variance o?, The second-order properties of each model 
are given by a spectral density function 5(-) defined over the 
interval |-1/(2At),1/(2At)] in cycles/At. The first model is a 
discrete parameter, white noise process (f° noise): 


X,me and S(f)=olAt 


The second model is a discrete-parameter random-wax process 
(nomunally f~? noise) 


X= and Sifi= 


= 


git 
4sin? ir fdt) 


The third model is a disctete-parameter. random-run process 
(nominally f~* noise 


ae oiat 
xa Ds and SN) = eran 


Continuous parameter versions of these three models have been 
used extensively in the literature as models for noise commonly 
seen in oscillators. 

For each of the three models we bave derived expressions 
for E{S(f)}, the expected value of Sif). These expressions 
depend on the window fy, the number of samples .V, in each 
block and — in the case of a random-run process — the num- 
ber of blocks Ny. The details behind these calculations will be 
reported elsewhere [3]; here we merely summanze our conclu- 
sions for the three models in combination with the uniform and 
Hanning windows and N, = 1024. 

First, for a white noise process. 


E(S(,)) = Sif), 


when the uniform window is used. For the Hanning window. 
the above equality also holds to » very good approximation for 
2¢) ¢ 51) and to within 0.8 dB for ) = 1 and $12 (the latter 
is of no practical importance since the highest frequency index 
gpven by the spectrum analyzer is ) = 400), These theoretical 
calculations agree with our expenmental data except at f\ (see 
Table 1) 
Second, for » random-walk process, 


E(S(J,)} = 2S1f,), 


221.2. 512, 


751.2. .,512, 


when the uniform window is used, ie. the expected value is 
twice what it should be at all frequencies. This theoretical re- 
sult bas been verified by Monte Carlo simulations. but st does 
not agree with our expermental data, which shows no mgnifi- 
cant level shift in the estimated spectrum. The source of this 
discrepancy is currently under investigation, but it may be due 
to either (a) factors in the experimental data which effectively 
make it band-limited, random-walk noise, i... its spectral shape 
is markedly different from f~? for, say, 0 < f < f, or (b) an 
incorrect guess on our part as to how the spectral estimate is 
normalized by the spectrum analyzer. For the Hanning window, 
we found that 


108S(f,) j=): 
148S(f,) 9 = 2 
L1SS(f,) 3 = 3% 
ESN = Lorstf) Ja 
1.04S(f,) 3 = 5: 
Sify) 6) ¢ 511 to within 3%, 


ice., S(f,) is ementially an unbiased spectral estimate except 
for the lowest few frequencies. This theoretical result has been 
verified by Monte Carlo simulations and also agrees in general 
with our experimental data. 

Third, for a random-run process, 


EUSf)}=Cxf-%, 1S 3 < 400. 
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to a good appoximation when the uniform window is used. 
where Cy, i$ 8 constant which depends on the number of blocks 
Ny and increases as Ny increases. Thus the shape of E(5(/,)} 
follows that of a random-walk process (f~?) rather than that 
of a random-run process (f~*). This shape has been verified 
experimentally (see the next subsection), but the dependence 
of the level on .V, has not. The increase in level of E{5S(f,)) as 
Np increases is due to the fact that the expected value of the 
sample vanance of 8 block of N, samples increases with time 
— by contrast, it 1s constant with time for the white noise and 
random-walk cases For the Hanning window, we found that 
E{S(f,))=Cn,5(f)), 47 $400, 

to a good approxmation, where again Cy, is @ constant — 
different from Cy, — which depends on the sumber of blocks 
Ny and increases as Ny increases. For frequencies less than 
fy the theoretical results indicate significant (greater than 4%) 
distortion in the shape, but these do not agree in detail with the 
expenmental values reported in Table 1. For f, > f, the shape 
has been verified experimentally, but the dependence of the level 
on Vy has not. The discrepancy in level between the theoretical 
and experimental results is yet to be resolved, but it is probably 
due to a mismatch between the assumed random-run model and 
the true spectrum for the data (possibly band-limited random- 
run), 


1) Verify Spectral Density Function & Voltage Reference 


2) Measure Spectrum Relative to Noise Source 
Requires Multiple Scans 


[Rrra weer as rN 
foe Sa et 
or 


3) Measure Filter Transfer Function h(f) 
5h 
oe Web 


4) Calculate Biases 


BCE) = Svat) - PACE) Sun(f) 


Figure 1. Outline of measurement procedure for determining 
the biases in spectral estimators, 


LB. Experimental Determination 


The following procedure can be used to experimentally de- 
termine the bias in the spectral estimate of any noise spectrum 
using any window in s particular instrument. The basic concept 
is to implement a filter that, when applied to white noise, mim- 
ics the approximate noise spectra of interest and then measures 
the level of the white noise and the filter transfer function in a 
way which bas high precision and accuracy as illustrated in Fig- 
ure 1. First, the level of a known white noise is measured over 
a convenient range. The higher the frequency span the faster 
that this is accomplished. Obviously, the chosen range must 
be one over which the noise source is accurate. To obtain 


precision of order 0.2 dB generally requires 1000 samples This 
measurement verifies that the spectral density function and the 
internal reference voltage of the FFT are accurately calibrated 
and working properly. Virtually all of the windows accurately 
determine the value of white noise if the first few channels are 
ignored as explained above. Figure 2 shows the measurement 
of a noise source, which bas been independently determined to 
have a noise spectral density of 99.8 dBV/Hz by the three win- 
dows. (Appendix A shows the circuit diagram for this noise 
source which has an accuracy of better thas 0.2 dB for frequen- 
cies from 20 to 20 kHz.) 
ws. 1000 
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Figure 2. Spectral estimation of a white noise standard us 
ing the uniform, Hanning and the propnetary “fattened peak” 
windows. 


Second, an approximately flat spectrum is measured over 
the frequency range of interest. It is not important if there are 
small variations in the level that change slowly over the fre- 
quency span. Third, the transfer function of the filter is deter- 
mined for the frequencies of interest using a very narrow spectral 
source (typically an audio oscillator 1s sufficient) The very nar- 
row source is accurately measured by the window since there is 
no problem with ether high frequency or low frequency noise 
biasing the estimate. The use of a window with a fattened peak 
response is helpful but not necessary if the frequency source is 
sufSicently stable. This transfer function is then applied to the 
measured white noise spectrum in step two above. This yields a 
very accurate value for the “true” spectral dennty of the white 
noise source as measured through the filter. This “true value” is 
then compared to that obtained by the FFT analyzer The dif- 
ference between that measured in steps two and three and that 
measured directly with the FFT is the bias in the spectral esti- 
mate for that particular window and noise type. The accuracy 
of this approach comes from the fact that the calibration has 
been broken up into steps that can individually be determined 
with high precision and very small bias. The primary assump 
tion is that the FFT analyzer is linear. Even this assumption 
can be checked by using precision attenuators. If the known 
white noise in step one does not extend to the frequencies of 
interest, then there is an additional assumption that the FFT 
is fiat with frequency. This assumption is nearly always good 
except perhaps near the last few channels where the cffect of 
the antialiasing filter might cause small inaccuracies 

Figures 3a and 3b show the “true” spectral estimate and 
the estimates as measured on a particular instrument using the 
uniform. Hanning, and the instrument's propnetary “fattened 
peak” windows for noise that varies as {~* over much of the 
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Figures 3a (top) and 3b (bottom) Difference between the true 
spectrum (top) which vanes approximately as f~* and that 
estimated by the unsform, Hanning and propnetary “fattened 
peak” windows (bottom) 


range from 1 kHz to 100 kHz. The scan is 0 to 100 kHz, and 
1000 samples were taken for al] curves. Note the considerable 
difference between the spectral estimates for channels | to 3 for 
the Hanning and proprietary “fattened peak” windows. These 
results confirm the theoretical calculations above showing that, 
for the Hanning window, the first 3 channels should be ignored. 
For the “flattened peak” window, the first 14 channels should 
be ignored. For both f~? and f~* noise, the uniform window 
does not yield usable spectral estimates over eny portion of the 
scan. Note in this example that at frequencies above 80 kHz 
there is a small step in the spectral estimates. This is due 
to digitizing errors of the mgnal due to quantization. If the 
digtizer bad more bits, these errors would not occur. This 
problem of dynamuc range is common whenever the spectrum of 
interest covers many decades. The usual solution is to use filters 
to divide the spectrum into various frequency range segments 
which are suitable for the dynamic range of the FFT 

Table 1 summarizes the measured experimental biases in 
the spectral estimates of particular instrument with three dif- 
ferent windows for power-law noise types varying from f° to 
{-*. This covers most of the random types of noise found in os- 
cillators and signal processing equipment. We do not advocate 
using the biases reported im this table to correct data — they 


Tabie 1 Apprommate Biases 


noise type f? 


channel # uniform Hanning 
T 196 dB 196 4B 
2 small small 
3 4 ’ 
4 
5 


noise type f7* 


channel # umform Hanning flattened peak 
1 unusable 86 4B 100 4B 
2 04dB 
3 04dB 
4 small 
5 4 
6 
7 
8 
9 
10 
u 
12 
13 
MW smal 
is 


only indicate which channels should not be relied upon for dara 
analysis 


TV. Variances of Spectral Estimates 
IV.A. Theoretical Analysis 


We have derived expressions for var {5\/\) — the vanance 
of S(f) — for exch of the three models considered in Section 
ILA, These expressions depend primarily on the sumber of 
blocks Vy. Again, the details behind these calculations will be 
reported elsewhere (3] 

First. for a white noise process, the uniform window sieids 


var{S(f)}= SUL )/M. 1S) $511 
while the Hanning window yields 
0.6957, pel 
var (S(f,)} = 4 S?0F,)/Ms. 2 
1.0357(f,)/M. 7 = 511 


‘These results are conmstent with our expenmental results and 
with standard statistical theory 

Second, for a random-walk process. the uniform sindow 
yields 


var{Sif,)) = 85°74, 1M 
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while the Hanmng window yields 


1.3057(f,)/M. 9 =; 
2.2057(f,)/Neo 7 = 25 
see Tie 253; 
LISSA )/M, 7 = 4 
eer(SUN =) roost(pyyNe, y= 5: 
1.0657(f,)/Ms, 9 =6; 
1.0487( f,)/Me, 9 = 7: 
HL )/N 8 <j $511 to within 3% 


Except for the few lowest frequencies, the results for the Han- 
ning window agree with our experimental results and with stan- 
dard statistical theory; however, the factor of five in the variance 
for the uniform window disagrees with our experiments and with 
standard theory (although it has been verified by Monte Carlo 
techniques). The cause of this discrepancy is under investiga- 
tion, but we think it is due to the band-limited nature of the 
experimental data 

Third, for a random-run process, the variance computa- 
tions are not useful since the variance is dominated by the fact 
that the expected value of the sample variance for each block of 
samples increases with time. The agreement which we found be- 
tween standard statistical theory and our experimental results 
on the 1/N, rate of decrease of variance is undoubtedly due 
to the band-limited nature of the experimental data. We will 
attempt to venfy these conclusions in the future using Monte 
Carlo techniques. 
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Figure 4. Comparison of the spectral estimate of f~* power- 
law noise with 1000 samples with that obtained with 32 sam- 
ples, The text explains how these two curves are used to obtain 
the fractional RMS confidence of the spectral estumate for 32 
samples, 


IV.B. Experimental Determination 


The following procedure can be used to experimentally de- 
termine the vanance of the spectral estimates of virtually any 
type of noise spectrum with any type of window for a particular 
instrument, Since the spectral density of interest is in general 
nonwhite, we must determine both the “true value” and 8 way 
to normalize the fractional error of the estimate as a function 
of the number of samples. This can be done by making use 
of the above theoretical analysis that shows that the vanance 
should decrease as the square root of the sumber of samples 
since they are approximately statistically independent (in fact, 
exactly so in the cases of white and random-walk noise). As an 


example we bave chosen to take Vy = 1000 bioeks of :be venous 
power-law noise types examined in IIIB above and compare the 
value of the spectral estimate with that obtained from Vy = 32 
blocks (see Figure 4). Since the variance of the 1000 block data 
is about 32 times smaller than that of the 32 block data. it can 
serve as an accurate estimate of the “true value.” Let Sig0( fy) 
represent this quantity at the j-th channel (frequency). By sub- 
tracting the 1000 block data from the 32 block data at the 7-tbh 
channel, we then have one estimate of the error for the 32 block 
data; by repeating this procedure over N, different channels 
and N, different replications, we can obtain accurate estimates 
of the variance for the 32 block data. Let 532,(f,) represent the 
spectral estimate for the 32 block data at the j-th channel and 
the 1-th replication. To compensate for the variation in the level 
of the spectral estimates with channel, it is necessary to divide 
the error at the y-th channel by the “true value” Sio90(f,). The 
mean square fractional error of the 32 block data for the noise 
type under study is given by 


= 2artSsn(f,)) 
H(f,) 


It is assumed that all channels with bias — as indicated in Ta- 
ble 1 — have been excluded in the summation over j. It is also 
important that the changes in the spectral density not exceed 
the dynamic range of the digitizer because under this condition 
the quantization errors — in addition to causing biases in the 
spectral estimates as discussed earlier — can lead to situations 
where the variance does not improve as NV, increases. These val- 
ues can be scaled to any number of blocks Ny if care is taken to 
avoid these quantization errors. Upper and lower approximate 
67% confidence limits for S(f,) — the true spectral density at 
channel » — using Hanning, uniform and the propnetary “fat- 
tened peak” windows for V, approximately independent blocks 
are given by . 
S(f,) (1 + Via, Ns) 


where 5(/,) is the spectral estimate given by Equation (1) and 
V(a..Ny) is the fractional variance gven in Table 2 for {® and 
@ = 0, -2, -3 and -4 (these results were obtained by averaging 
over N,N, = 1200 channels), The variances obtained are very 
close to those obtained from standard statistical anslysis for 


white noise, i.e, 
sa(1 + =x) 


Table 2. Confidence Intervals for FFT Spectral Estimates 


power law window 

noise type uniform Banning flattened peak 
r 1.02//™ 0.98/ JM 0.98//™ 
Ys 102/VNP LKR 04/ VN 
r unusable 1.06//™ 1.04/55 
ii unusable 1.04/ JN) 1.04//55 


V. Conclusions 


We have introduced experimental techniques to evaluate 
the statistical properties of FFT spectral estimates for common 
noise types found in oscillators, amplifiers. cuxers and simular 
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devices and we Save compared these witn ioeorencal tacua- 
tions We bave used :bese tecaniques to study tne biases and 
vanances of FFT spectral estimates using the uniform. Han. 
ning. and a propretary “fattened peak” window The theo 
reveal analysis was greatly bampered because the instrument 
manufacturer does not disclose the exact form of the “fattened 
peak” window or the normalization procedure for the other win- 
dows Nevertheless. we obtained fair agreement between the 
theoretical and the expenmental analyns. The vanances of 
the spectral estimation were virtually identical to # few per- 
cent for f° to f~* noise except for the unform window which 
is incapable of measunng noise which falls off faster than f~? 
There was a very large difference in the biases of the first few 
channels for the three windows The Hanmng window showed 
signuficant biases in the first 3 channels while the propnetary 
“flattened peak” window showed large biases for /~* nowe even 
up to channel 13. The Hanning window therefore yelds useful 
information over three umes wider frequency range than the 
propnetary “fattened peak” window In the particular instru- 
ment studied. the propnetary “fattened peak” window is the 
best choice for estimating the height of s oarrow band source. 
while the Hanning window 1s by far the best choice for spectral 
analysis of common noise types found in oscillators, amplifiers. 
muxers, etc, We have also shown that the 67% confidence levels 
for spectral estimation as a function of the number of contiguous 
nonoverlapping biocks. .Vj, is approxumateiy given by 


Figure 5. Circuit diagram of a precision noise source 


Appendix. Precision Noise Source 


Figure $ shows the circuit diagram of a precision noise 
source whose spectral dennty can be determined from first pnia- 
ciples to +0.2 dB over the frequency range from 20 Hz to 20 kHz. 
The spectral density is basically given by the Johnson noise of 
the 10° obm renstor. ¥? = 4k7R, where T is in Kelvin, and & is 
Boltzmann's constant. Corrections due to the input noise volt- 
age and noise current of the amplifier amount to about 0.2 dB 


for whute norse ( f") and by 


S=5n (12th) 


for noise types f-? to f-* This agrees to within 4% of that 
found by standard statistical analyms for white noise Caine 
this data one can now determine the number of sampies aec: 
essary to estimate — to a given level of statistical uncertainty 
— the spectrum of the vanous noise types commoniy found wa 
oscillators, amplifiers, suxers. ete 
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for the cireuit elements shown All resistors are precition |” 
metal film renstors. The output level can de switches from 
-100 dBV/Hz to -80 dBV/Hz. By adjusting the novse-gaiz ca 
pacitors one can make the noise spectrum fiat to within 03 4B 
out to 200 kHz. There is also provision to measure the :aput 
noise voltage of the amplifier by shorting the input to grou 

or the combined nowse voltage and noise current by seitcmung & 
220 pF capacitor into the input instead of the 10° ohm noise 
remstor 
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A MODIFIED "ALLAN VARIANCE" WITH INCREASED 
OSCILLATOR CHARACTERIZATION ABILITY 


David W. Allan and James A. Barnes 


Time and Frequency Division 
National Bureau of Standards 
Boulder, Colorado 80303 


Heretofore, the Variance," 0.2(t), has 
become the de facto standard for measuring oscil- 
Vator instability in the time-domain. Often 
oscillator frequency instabilities are resonab] 
modelable with a power law spectrum: S$ (f) ~ ” 
where y is the normalized frequency,’f is th 
Fourier frequency, anda is a constant over some 
range of Fourier frequencies. It has been shown 
that for power law spectrum o.2(1) ~ 0, and that 
p= -a-l for -3<ac +1, wherd rt is the nomimal 
sample time over which each value of y is measured. 
The modified “Allan Variance" developed in this 
paper yields p = -a-) for al] a in the range -3<a, 
which removes the previous ambiguity: p = -2 for 
+1< In other words, with the modified "Allan 
Variance" one can easily distinguish between white 
phase noise (a = +2) and flicker phase noise 
(a = +1) -- commonly occurring for the short term 
instabilities of quartz crystal oscillators and 
active hydrogen masers. 


Words. Flicker Noise; Frequency Stability; 
sc tor Noise Modeling; Power Law Spectrum; 
Time-Domain Stability; White Noise. 
Introduction 
The random fluctuations in precision oscil- 
Jators may often be characterized by a power law 
spectrum: 


sf shy a) 


where y is the normalized frequency deviation, f 
is the Fourier frequency, nh, is the intensity of 
the particular noise process, and a fs constant 
over some range of f. 
ar 


The typical values of a 
*2 (white noise phase modulation, PM); +1 
(flicker noise PM); © (white noise frequency 
modulation, FM); -1 (flicker noise FM); and -2 
(random walk FM). The Allan variance 
come to be known, has been demonstrated as a very 
useful statistical tool for characterizing these 
various random processes with the exception that 
ifa = ¢l or +2, the dependence on t is nominally 


as it has 
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the same, i.e., ~ t-2, It is not at all uncommon 
for white PM and flicker PM to occur in precision 
oscillators for t of the order of one second and 
shorter. The modified Allan variance, as develop- 
ed in this paper, depends as t-? for a = +1 and as 
17? for a = +2. This yields a clear distinction in 
the time domain between these heretofore somewhat 
ambiguous processes. 


Definition of “Allan Variance" 


and Related Concepts 
Define y, the normalized frequency deviation, 


as 


v(t) - 


‘0 


y(t) = (2) 


where v(t) is the output frequency of the oscilla- 
tor being studied, and v, is nominally the same 
frequency, but of a reference oscillator assumed 
for the moment without loss of generality to be 
better than the test oscillator. The time devia~ 
tion from some arbitrary origin (t = 0) is the in- 
tegral of the frequency deviations (from that 
origin): 


t 
xe) = fyce) at! @) 
° 


the 1% 
val, t, fs 


erage frequency deviation over an inter- 
5 Se 
ie $a i «) 


where the assumption is made that the time devia~ 
tion measurements are nominally spaced t apart. 


The “Allan Variance” is defined as: 


O20) = $ <H441 “YP + (s) 


where the brackets "<>" denote infinite time 
average. Using equation (4), one may write: 

ay3(t) = gy Cig = ju, HY (6) 

Tt has been shown that typically 0,?(t) 
varies as tY, and that p = -o-1 for -3 <a ¢ #1}? 
Hence, we see one of the dimensions of usefulness 
of o,7(t); f ascertaining the dependence on t 
allows an estimate of a (the power law spectral 
type of noise). However, if a > +1, theny = -2, 
and the t dependence becomes somewhat ambiguous as 
to the type of noise in this region. It fs inter- 
esting to note that in the region a > #1, o 2(t) 
4s bandwidth (f,) dependent; f.e., the bandwidth 
of the measurement system will affect the value of 
oy(t), and furthermore, one may use the bandvidth 
dependence’ to determine the value of a (see also 
Appendix Ref. 2). 


Development of the Modified Allan Variance 
One may also write o2(t) in terms of a 


generalized autocovariance function: 


ay2(t) = aby F400) = 2D) , 2) 
where 

UC) = 208, (0) - RCI. ro) 
and where 

R(t) = <x(ter) + x(t), (3) 


the classical autocovariance function of x(t). 
Using the Fourier transforms of generalized func- 
tions, one may determine the coefficients relating 
the power spectral density to o 2(r), Ref. 1 
gives these relationships. It is of interest to 
note that U,(t) has the following approximate form 
in the region a > + 1 (see Appendix Ref. 2): 
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1 cat] vat] 
U,(2) ~ aa) lat = It «oy 


Hence, one notes that by changing the reciprocal 
bandwidth as well as t, one affects oy2(t) in 
similar ways, depending on the value of a. From 
this, one should be able to deduce the value of a, 
since the bandwith dependence becomes stronger for 
a moving positive from +1, and the t dependence 
becomes stronger as a moves negative from +1. One 
an change the bandwidth in the hardware or in the 
software, In the past, it has typically been done 
in the hardware? James Snyder* has shown that it 
is relatively easy to change the bandwidth in the 
data processing by a clever technique and we have 
followed his lead. In particular, we have chosen 
a new variance analysis scheme which coincides 
with the Allan variance at the minimum sample 
time, Ts (i.e., minimum data spacing), but which 
changes the bandwidth in the software as the 
sample time, t, is changed. 

Each reading of the time deviation, x,, has 
associated with it an intrinsic nominal (hardware) 
measurement system bandwidth, f,,. 
| ori and similarly we may define a software 
bandwidth, f, = fy/n, which 1s 1/n tines narrower 
than the hardware bandwidth. This software band- 
width can be realized by averaging n adjacent 
xj'S) Ty = Mey, where t. = 1/f,. We nave defined 
a modified Allan variance which allows the recipro- 
cal software pandwidth to change linearly with the 


Define 


sample time, 


\ 
1 /h : 2\ 
eta A6e'= a(t Dee Ge2n * Bian «] jad 
ie1 / 
where t= At. Eq, 11 clearly coincides with Eq. 
6 for n= 1. One can see that, in general, we 
have formed a second difference of three time 
readings with each of the three being an average 
of n of the x,'S (with non-overlapping averages). 
As n increases, the (software) bandwidth decreases 
and this bandwidth varies just as f, = f,/n. 
For a finite data set of Nireadings of x, 
(i = 1 to N), we may write an estimate: 


Mod 0200) = FERTTRT * 
(2) 
Ne3n4l  [nej-1 2 
r= x Osean 7 ian tq) 


Eq. 12 is easy to program, but takes more time to 
compute than for o (tr). This is only of signifi- 
cance for the smaller computer or handheld calcu- 
lator. 


Comparisons, Tests, and Examples of Usage 
of the Modified Allan Variance 

We simulated vartous power law noise proces- 
ses, and applied Eq. 12. Shown in Fig. 1 are the 
resulting t-dependences of the modified Allan 
variances for a= -2,-1, 0,41, and +2. The 
solid lines drawn are the anticipated or theoreti- 
cal slopes for the particular noise process, One 
sees excellent agreement for white noise PM and 
for flicker noise PM, and nominal agreement for 
the others. 

One can express Eq. 11 in terms of the gen- 
eralized autocovariance function: 


1 
Mod 0,7(t) = a2anr {eco “UQd] +A 


n-1 
+ XS cw tyt-su,(irg) + 4u,((nefe,) 
se a3) 
# AU, (Ene 1)tg) + Ug(C2n*i)t) 
=U CC2n-H)eQ)1} 
In the range -3 < a < #1, one may write: 
u(t) = ata) oe), as) 


which when substituted in Eq. 13, and using Eq. 7, 
yields 


1 1 
Mod o.2(t) = 0.2 ps . 
ay2(t) = o,2(t) {i Pr > Sapa | Gay 


a1 
De ort + Fer? + acnesyet as) 
i=1 


(amet)? + a¢neiy et - camaro} 


Since we know that oy7(t) is well behaved in this 
range and p= -a -1, it is of interest to look at 
the ratio: 


R(n) = Mod oy (u)/o,2(t) ‘ 


As stated before, at n= 1 (t= t,) the ratio is 
unity. One can evaluate Eq. 15 with a computer. 
A reasonable empirical fit may be formed, which is 
good to 0.5% or better of Eq. 15: 


— 
a(n) = 222 = B as) 


qn 


which approaches p/q asymptotically as nm ap- 
proaches infinity, and is within 1% of p/q for 
n> 8. Listed in Table 1 are the empirical values 
of p, q, and E and the quality of fit for the 
appropriate power law noise processes. 


ae 
ioe yer oe 0, (0070,00) 
om 7 . t mm vot, 
wine * 3 2 2 perfect 107 
Fier ke aw ny 
Rancom wate 2D ” 2m oe 8 

Fiyener wale EDL a = perfect a 


The results of Table 1 are in reasonable 
agreement with simulated results of Fig. 1(a) 
through 1(e). The last row in Table 1, “flicker 
walk" frequency modulation, is out of the range of 
applicability of a, but the ratio, R(n), is still 
convergent. 


The U,(t) function for flicker noise PM is 
extremely complicated and has not been developed, 
but one can arrive at an empirical value for it. 
The U,(t) function is derivable for the other 
power law spectral processes. Table 2 gives the 
relationships between the time domain measure 
Mod o,2(t) and its power law spectral counterpart, 
given in Eq. 1. Also listed in the right hand 
column of Table 2 are the asymptotic values 
of R(n): 


TARE? 
Se or 
oo mee 0,0) Comment oe 
— ° ¥ 

2, 
wie 2 ‘sat Eoact a 

1.008 + Bunce) 
Fleer mh . 3 Kapirica! ry 
fo) 

weit ° wa fact os 
Filewer L meq Band) = en) Eaoirica); Enect 0 674 


‘aval table 


Rance wale PH 2 


22 am 


Emwiricad, Canct 0 828 
‘acattabte 


It is clear from Table 2 that Mod o ?(t) is 
very useful for white PM and flicker noise PM, but 
for a < +1 the conventional Allan variance, 0 ?(t), 
gives both an easfer-to-interpret and an easier-to- 
calculate measure of stability. 

It is interesting to make a graph of a versus 
# for both the ordinary Allan variance and the 
modified Allan variance. Shown in Fig. 2 fs such 
a graph. This graph allows one to determine power 
law spectra for non-interger as well as interger 
values of a. The dashed line for the modified 
Allan variance has been intentionally moved to the 
left in Fig. 2 because for small values of n the 
value of yp will appear to be slightly more negative 
that for oy7(t), even though for large n, they 
both approach the same slope (i.e., the sane 
values of y). In fact, in the asymtotic limit, 
the equation relating »p and a for the modified 
Allan variance is 


o=-p-l, for-3<ac43. a7) 


* See Appendix Note # 34 


The value of » = -4 for a = +3 was verified empir- 
ically with simulated da and it appears that 


for a > +3, y remains at -4. 

A direct application for using the modified 
Allan variance recently arose in the analysis of 
atomic clock data as received from a Global 
Positioning System (GPS) satellite. We were 
interested in knowing the short-term characteris- 
tics of the newly developed, high-accuracy NBS/GPS 
receiver, as well as the propagation fluctuations. 
Fig. 3 shows both o ?(1) and Mod 0. 2(t) for com- 
parison, Using Mod o,2(t), we can tel) that the 
fundamental] limiting noise process involved in the 
system is white noise PM with the exciting result 
that averaging for four minutes can allow one to 
ascertain time difference to better than one 
nanosecond excluding other systematic effects, 


Conclusion 

We have developed a supplemental measure, the 
"Modified Allan Variance" (Mod o/2(t)), which has 
very useful properties when analyzing oscillator 
or signal stability in the presence of white noise 
phase modulation or flicker noise phase modulation. 
It also works reasonably well as a stability 
measure for other commonly occuring noise processes 
in precision oscillators. 

We would recommend that for most time domain 
analysis, 0,2(t) should be the first choice. If 
o,2(1) depends on t as t-1, then the modified 
Allan variance can be used as a substitute to help 
remove the ambiguity as to the noise processes, 
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Characterization of Frequency Stability: Analysis of 
SAMPLE TIME,T the Modified Allan Variance and Properties of 
Its Estimate 
Mod o,(t) using Eq. 12 was calculated for different sample times for 
independently generated and simulated noise processes, which were 
white phase noise, flicker phase noise, white frequency noise, 
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Abstrect—An analytical expression for the modified Allan variance is 
given for each component of the model usually considered to describe 


flicker frequency noise, and random walk frequency notse, respec- ths tyeqwoncyon piss Tioctuailes ia frequency ctandarda, ‘The rly 
tively. Mod a(t) was computed for 399 data points in each case. tion between the Allan variance and the modified Allan variance is 

* ‘. hi i ad specified and compared with that of s previously published analysis. 
One sees the excellent fit to the theory for white phase noise ai La oe Ge Gua cio count Met ied 


flicker phase noise, an important new contribution in the ability to iciad $70i u‘tesaa cet of prssevveninet Gate 0 digchiigsd: 
characterize oscillators having these noise processes. 
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[. INTRODUCTION 


Many works {1|-[5] have been devoted to the characteriza- 
tion of the frequency stability of ultrastable frequency sources 
and have shown that the frequency noise of a generator can be 
easily characterized by means of the “two-sample variance” 
(2] of frequency fluctuations, which is also known as the 
“Allan variance’ [2] in the special case where the dead time 
between samples is zero. 

An algorithm for frequency measurements has been devel- 
oped by J. J. Snyder (6), [7]. It increases the resolution of 
frequency meters, in the presence of white phase noise. It has 
been considered in detail by D. W. Allan and J. A. Barnes (8]. 
They have defined a function called the “modified Allan 
variance’’ and they have analyzed its properties for the com- 
monty encountered components of phase or frequency fluctu- 
ations [3], For that purpose, the authors of [8] have expressed 
the modified Allan variance in terms of the autocorrelation of 
the phase fluctuations. For each noise component, they have 
computed the modified Allan variance and deduced an empiri- 
cal expression for the ratio between the modified Allan variance 
and the Allan variance, 

In this paper, we show that the analytical expression of this 
ratio can be obtained directly, even for the noise components 
for which the autocorrelation of phase functions is not defined 
from the mathematical point of view. We give the theoretical 
expressions and compare them with those published in [8]. 

The precision of the estimate of the modified Allan variance 
is discussed and results related to white phase and white fre- 
quency noises are presented. 


Il, BACKGROUND AND DEFINITIONS 


In the time domain, the characterization of frequency stability 
is currently achieved by means of the two-sample variance 
[2] (03(2, T, 7)) of fractional frequency fluctuations. It is 
defined as 

(02, T, m=h (Fees - Fe)? a) 


where the quantity 7 is the average value of the fractional fre- 
quency fluctuations y(r) over the time interval (t,, te +1) 


such that 
ter 
i) (dt, «2 


'k 
In (2), te represents the moment at which the kth observation 
time interval starts. We have 

Mo tkT, TPT (3) 


where fo is an arbitrary time origin, k is a positive integer, and 
T is the time interval between the beginning of two successive 
observations. 

In all the following, we assume that the dead time between 
samples is zero. We then have 


Ter, (4) 


In this special case, the two-sample variance is well known as 
the Allan variance 0} (7) 


03,(r) = 403 (2, 7,7). (5) 


The relation between the Allan variance and y(t) can be ex- 
pressed as 


1 teat ter 2 
Fr) = Uf y(t) dt -f y(t) at} 4 
2 ner fs 


Equation (6) shows that 0}(r) is proportional to the true vari- 
ance of the output of a linear filter with input signal y(t) and 
impulse response /1 (t) in Fig. 1. 


Tr 


Fig. 1. Variations with time of the linear filter impulse response which 
represents the signal processing for the Allan variance calculation. 


Fig. 2. [lustration of the algorithm considered for the measurement of 
periodic signal frequency. 


The fractional frequency fluctuations y(t) are actually well 
described by a conventional model which consists of a set of 
five independent noise processes [2]. Taking into account the 
finite bandwidth of the processed signal and assuming a single 
pole filter, the one-sided power spectral density Sy() of y(s) 
can be written as 


m 


where coefficients hg do not depend on f. The integer a equals 
2,1, 0,-1, and -2. f is the 3-dB bandwidth of the hardware 
filter. 


Ill, THE MODIFIED ALLAN VARIANCE 


The main property of the algorithm developed by J. J. 
Snyder is to increase the precision on the measure of periodic 
signal frequency, in presence of white phase noise (7]. It con- 
sists in dividi time interval r into ” cycles of clock period 
To such as 


T= NT. (8) 


Therefore, from a given observation time interval of duration 
21, nm overlapping time intervals of duration r can be obtained, 
as depicted in Fig 2. Another property of this algorithm is to 
reduce the total observation time by a factor n/2. 

Following this way, Allan and Barnes have introduced the 
“modified Allan variance” [8] such as 


lod 3, (7) = —> (zt x | lonaigg y(t)de 


+(ien)to 


19+ (len)ro 
-f vioar} ). (9) 


fatto 
It can be easily seen from (9) that the calculation of gach 
statistical sample involved in the definition of Mod op(r) 
requires a signal observation of duration 37. 
The impulse response A, (rt) of the equivalent linear filter 
consists in finite sum of n shifted impulse responses h,(r). 
We have 


halt = Ault ito). qo) 
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TABLE 1 


ANALYTICAL EXPRESSION FOR THE MODIFIED ALLAN VARIANCE WITHIN 
Conpimion 2 for» >> 1 


Saye and 
Ea 
i 


+ lk enjine ampere en +t 


“temo 


FLICKER F 


RANDOM WALC FM 


In order to illustrate (10), variations with time of the shifted 
functions h,(t~ ito) and of the impulse response A, (r) are 
represented in Fig. 3(a) and (b), respectively, for n = 10, 

Forn @ 1, the Allan variance and the modified one are equal, 
We have 


Mod 3 (r) = 03(7). a) 
One can express (9) in terms of the spectral density S,(/). 


i axtn| 7 


Mod 03, (1) = => 


y(f) sin’ (mfnto) df 


pe sical” =z Sy(S) cos (2fkro) 
mo 
*sin* cwinre) as}, (12) 


It should be noted that the integrals involved in (12) are con- 
vergent for each noise component. The analytical expression 
for the modified Allan variance can therefore be deduced 
directly from this equation. 

In the following, it is assumed that the condition 2#f, tT) >> 1 
is fulfilled. This means that the hardware bandwidth of the 
measurement system must be much larger than the reference 
clock frequency. 

We have calculated the modified Allan variance for each 


noise component. Results are reported in Table I. It appears Fig, 


that the analytical expression for Mod 3 (7) is relatively simple 
except for flicker phase and flicker frequency noises where it 
is given as a finite sum of functions depending on n. In order 
to compare the Allan vanance with the modified one, we 


ait edniiniken « aio afin + te len(h ©3) 


nk) fg [io e2eitne zai 2nenian ead 


? 


Fe T. jets yee, 


3. (a) The impulse response hq(t), associated with the modified 
Allan variance calculation, represented as a sum of m shifted impulse 
response Ay(t), It is assumed m= 10. (b) Variations with time of 
the impulse response hy (t), in the special case where m = 10. 


‘¥ See Appendix Note # 35 
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TABLE II 
ASaLyricat EXPRESSIONS 48D Asyuprotica: Vates for Rin) 
{Results Are Valid within Condition 2x f:r5 >> 1) 


Nea) 43 [i + 2njin(e 2m) 


sajlestnjin ken ode 


consider the ratio R(n) defined in (8) as 
R(n) = Mod o}(1)/03 (1). (13) 


The analytical expressions for R(n), deduced from Table I, 
are reported in Table II, One can see that R(m) does not 
depend on the product fT), except for flicker phase noise 
modulation, The asymptotic values of R(n) are also listed in 
Table Il, 

Fig. 4 depicts the variations of R(n) with n. It shows that, 
for large values of m, white phase and flicker phase noise 
modulations have different dependences. As outlined in [8], 
this gives a means to easily distinguish these two noise pro- 
cesses, in the time domain. For large n, and fora =0,-1,-2, 
R(n) remains a constant. Consequently the Allan variance can 
be deduced from the modified one, for these noise processes. 

A comparison with results of [8] shows a good agreement 
for a= 2, 0 and-2. But, fora = and ~-1, our expressions for 
the modified Allan variance and ratio R(n) disagree, especially 
for flicker phase noise modulation. This discrepancy might 
be due to the fact that in [8], Mod o}(r) is expressed in terms 
of the autocorrelation function of phase fluctuations which 
is not defined fora = 1. 


IV. UNCERTAINTY ON THE ESTIMATE OF THE 
MODIFIED ALLAN VARIANCE 


Equation (9) shows that the definition of the modified Allan 
variance theoretically implies an infinite set of time intervals. 

Practically, one can only estimate this quantity from a finite 
set of m successive cycles similar to the one depicted in 
Fig. 3(b). 

Let Mod 6}(r) be the estimated modified Allan variance 
(EMAY) such as 


ms 1 
Mod G(r) = Sag X ee LE (Fava) aa) 


im 


antacen-ti) 


# gon = afin e2uhante =F) 


ain 


’ ° ot 


Fig. 4. Variations with n of the ratio Rim), for fractional freque 
fluctuations with power law spectrum Sy(/) * hay (1/1 + (fife ier, 
within condition 2#f,19 >> 1. (*Fora* +1, R(n) isa function of fe 
and ro. The reported variations are for 2#/-r9 = 10°.) 


where 
9+ (i+ 2n) 9 + (= 1)30Fo 
Aik -/ . y(t) dt 
ig + (ien)t9 © (k-1)3000 
fo+ (ien)79 + (k-1)3"70 
-f yids. (is) 


fot irg+(k-1)3079 
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The EMAV 1s a random function of m. Its calculation requires 
an observation time of duration 3mr_ 

We consider €, the fractional deviation of the EMAV relative 
to the modified Allan variance defined as follows 


Mod 6}(r) - Mod 0}, (r) 
Mod 0} (r) 


The standard deviation o(€) of € defines the relative uncertainty 
on the measurement of the modified Allan variance, due to the 
finite number of averaging cycles, We have 


a a6) 


ate) = {07 [Mod 63(r)}}"/? a?) 


Mod aa 
where o? [Mod @ oy 2(7)] denotes the true variance of the EMAV 
such as 


a? [Mod G}(r)] = (Mod G3(r)]?)- (Mod o3(r)]?. (18) 


We assume that the fluctuations y(t) are pormally distributed 
(10). One can therefore express ([Mod 3} (r)}?) as 


m?((Mod 63(7)}?) 
= (m? + 2m) [Mod 03(7)}? 
mst ast bs 
+45 (m- p)j2 > (n- in tno ay) 
pal Tay 


where /,, are integrals which depend on n and on the noise pro- 
cess, We have 


8r?77n77, = f af cos 6mnpfto 
0 


X {6 cos 2nfroi- 4 cos 2nf/79(i +n) 
~ 4 cos Infro(i - m) + cos 2nfro(i + 2n) 
+ cos 2nfro(i- 2n)} df. (20) 


For each noise component, the expression for o(€) can be 
deduced from the calculation of integrals involved in (20). 
These expressions are generally lengthy and complicated except 
for white phase and white frequency noise modulations, where 
integrals J, equal zero. We have limited the present analysis 
to these two noise components. We get for o(€) 

a(e)*—, for a=2 and 0. ea) 
We now compare (21) with previously published results related 
to the estimate of the Allan variance [S$], For a given ime 
observation of duration 3mr, it can be easily deduced from 
{5} that the relative uncertainty on the estimate of the Allan 
variance varies asymptotically as 1.14 m~"/? and 1.0m“? for 
@ = 2and 0, respectively. For these two noise components, the 
uncertainty on the EMAV is larger than the uncertainty on the 
estimated Allan variance, but of the same order of magnitude. 


V. CONCLUSION 


We have calculated the analytical expression for the modi- 
fied Allan variance for each component of the model usually 
considered to characterize random frequency fluctuations in 
Precision oscillators. These expressions have been compared 
with previously published results and the link between the 
Allan variance and the modified Allan variance has been 
specified 

The uncertainty on the estimate of the modified Allan vari- 


ance has been studied and numerical values have been reported 
for white phase and white frequency noise modulations. 

In conclusion, the modified Allan variance appears to be well 
suited for removing the ambiguity between white and flicker 
phase noise modulation, Nevertheless, the calculation of the 
modified Allan variance requires signal processing which is 
complicated, compared to the Allan variance, In the presence 
of white or flicker phase noise, the Allan variance cannot be 
easily deduced from the modified Allan variance. Further- 
more, for a given source exhibiting different noise components, 
the determination of the Allan variance from the modified 
one is difficult to perform. Fos most of time-domain measure- 
ments, the use of the Allan variance is preferred. 
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ABSTRACT 


A linear drift in frequency is an important element in most 
stochastic models of oscillator performance. Quartz crystal 
oscillators often have drifts in excess of a part in ten to 
the tenth power per day. Even commercial cesium beam devices 
often show drifts of a few parts in ten to the thirteenth per 
year. There are many ways to estimate the drift rates from 
data samples (e.g., regress the phase on a quadratic; regress 
the frequency on a linear; compute the simple mean of the 
first difference of frequency; use Kalman filters with a 
drift term as one element in the state vector; and others). 
Although most of these estimators are unbiased, they vary in 
efficiency (i.e., confidence intervals). Further, the esti- 
mation of confidence intervals using the standard analysis 
of variance (typically associated with the specific estima- 
tion technique) can give amazingly optimistic results. The 
source of these problems is not an error in, say, the re- 
gressions techniques, but rather the problems arise from 
correlations within the residuals. That is, the oscillator 
model is often not consistent with constraints on the analy- 
sis technique or, in other words, some specific analysis 
techniques are often inappropriate for the task at hand. 


The appropriateness of a specific analysis technique is crit- 
ically dependent on the oscillator model and can often be 
checked with a simple “whiteness” test on the residuals. 
Following a brief review of linear regression techniques, 

the paper provides guidelines for appropriate drift estima- 
tion for various oscillator models, including estimation of 
realistic confidence intervals for the drift. 


I. INTRODUCTION 


Almost all oscillators display a superposition of random and deterministic 
variations in frequency and phase. The most typical model used is : 


X(t) = a + bet + Dret2/2 + 4(t) qa) 
where X(t) is the time (phase) error of the oscillator (or clock) relative to 
some standard; a, b, and Dr are constants for the particular clock; and g(t) is 
the random part. X(t) is a random variable by virtue of its dependence on 9(t). 


¥ See Appendix Note # 36 
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Even though one cannot predict future values of X(t) exactly, there are often 
significant autocorrelations within the random parts of the model. These cor- 
relations allow forecasts which can significantly reduce clock errors. Errors 
in each element of the model (Eq. 1) contribute their own uncertainties to the 
prediction. These time uncertainties depend on the duration of the forecast 
interval, t, as shown below in Table 1: 


TABLE 1. GROWTH OF TIME ERRORS 


MODEL ELEMENT CLOCK RMS TIME 
NAME PARAMETER ERROR 
Initial Time Error a Constant 
Initial Freq Error b -T 
Frequency Drift Dr - 12 
Random Variations (et) ~ 13/2 


*The growth of time uncertainties due to the random component, ¢(t), 
can have various time dependencies. The three-halves power-law 
shown here is a “worst case” model. [2 


One of the most significant points provided by Table 1 is that eventually, the 
linear drift term in the model over-powers all other uncertainties for suffi- 
ciently long forecast intervals! While one can certainly measure (i.e., esti- 
mate) the drift coefficient, Dr, and make corrections, there mst always remain 
some uncertainty in the value used. That is, the effect of a drift correction 
based on a measurement of Dr, is to reduce (hopefully!) the magnitude of the 
drift error, but not remove it. Thus, even with drift corrections, the drift 
term eventually dominates all time uncertainties in the model, 


As with any random process, one wants not only the point estimate of a para- 
meter, but one also wants the confidence interval. For example, one might be 
happy to know that a particular value (e.g., clock time error) can be estimated 
without bias, he may still want to know how large an error range he should 
expect. Clearly, an error in the drift estimate (see Eq. 1) leads directly to 
a time error and hence the drift confidence interval leads directly to a confi- 
dence interval for the forecast time. 


II. LEAST SQUARES REGRESSION OF PHASE ON A QUADRATIC 
A conventional least squares regression of oscillator phase data on a quadratic 
function reveals a great deal about the general problems. A slight modifica- 


tion of Eq. 1 provides a conventional model used in regression analysis : 


X(t) = a + bet + crt2 + $(t) (2) 


$52 
TN-265 


where c = Dr/2. In re, fon analysis, it is customary to use the symbol “Y” 
as the dependent variable and “X" as the independent variable. This is in con- 
flict with usage in time and frequency where "X" and "Y" (time error and fre- 
quency error, respectively) are dependent on a coarse measure of time, t, the 
independent variable. This paper will follow the time and frequency custom even 


though this may cause some confusion in the use of regression analysis text books. 


The model given by Eq. 2 is complete if the random component, $(t), is a white 
noise (1.e., random, uncorrelated, normally distributed, zero mean, and finite 
variance). 


II1. EXAMPLE 


One must emphasize here that ALL results regarding parameter error magnitudes 
and their distributions are totally dependent on the adequacy of the model. A 
primary source of errors is often autocorrelation of the residuals (contrary to 
the explicit model assumptions). While simple visual inspection of the resi- 
duals is often sufficient to recognize the autocorrelation problem, “whiteness 
tests" can be more objective and precise. 


This section analyzes a set of 94 hourly values of the time difference between 

two oscillators. Figure 1 is a plot of the time difference (mea d in micro- 
seconds) between the two oscillators. The general curve of the data along with 
the general expectation of frequency drift in crystal oscillators leads one to 

try the quadratic behavior (Model #1; models #2 and #3 discussed below). While 
it is not common to find white phase noise on oscillators at levels indicated on 
the plot, that assumption will be made temporarily. The results of the regres- 
sion are summarized in a conventional Analysis of Variance, Table 2. 


TABLE 2. ANALYSIS OF VARIANCE QUADRATIC FIT TO PHASE 
(Units: seconds squared) 


‘SOURCE SUM_OF SQUARES def. MEAN SQUARE 
Regression 2.32E-9 z 
Residuals 4.26E-12 91 4.68E-14 
Total 2.329E-9 94 2.48E-11 


Coefficient of simple determination 0.99713 
Parameters: 
2 = 1.10795E-5 (seconds) t-ratio = 161.98 
6 = 1.4034E-10 (sec/sec) t-ratio = 152.02 


= -3.7534E-16 (sec/sec?) t-ratio = -143.51 


o> 


$53 


1.99 ws 


x(t) 


554 


RUNNING TIME (HOURS) 


1.74 yes 


1 - Phase difference 


Pig. 


Br = 22 = -7.507E-16 (about -6.5E-11 per day) 
Std. Error = 0.05231E-16 


(Note: @ is the value estimated for the a-parameter, etc.) 


The Analysis of Variance, Table 2, above suggests an impressive fit of the data 
to a quadratic function, with 99.71% of the variationg in the data “explained” 
by the regression. The estimated drift coefficient, Dr, is -7.507E-16 (sec/sec2) 
or about -6.5E-11 per day --- 143 times the indicated standard error of the 
estimate. However, Figure 2, a plot of the residuals, reveals significant auto- 
correlations even visually and without sensitive tests. (The autocorrelations 
can be recognized by the essentially smooth variations in the plot. See Fig. 5 
as an example of a more nearly white data set.) It is true that the regression 
reduced the peak-to-peak deviations from about 18 microseconds to less than one 
microsecond. It is also true that the drift rate is an unbiased estimate of the 
actual drift rate, but the model assumptions are NOT consistent with the auto- 
correlation visible in Fig. 2. This means that the confidence intervals for the 
parameters are not reliable. In fact, the analysis to follow will show just how 
extremely optimistic these intervals really are. 


At this point we can consider at least two other simple analysis schemes which 
might provide more realistic estimates of the drift rate and its variance. Each 
of the two analysis schemes has its own implicit model; they are: 


(2) Regress the beat frequency on a straight line. 
(Model: Linear frequency drift and white FM.) 


(3) Remove a simple average from the second difference of the phase. 
(Model: Linear frequency drift and random walk FM.) 


Continuing with scheme 2, above, the (average) frequency, Ye), is the first 
difference of the phase data divided by the time interval between successive 
data points. The regression model is: 


Y(t) = b + Dret + e(c) (3) 
where c(t) = [$(t + to) - $(t)]/to» Following standard regression procedures as 
before, the results are summarized in another Analysis of Variance Table, Table 
3. 


TASLE 3. ANALYSIS OF VARIANCE LINEAR FIT TO FREQUENCY 
(Units: sec2/sec?2) 


SOURCE SUM_OF SQUARES def. MEAN SQUARE 
Regression 1,.879E-18 2 
Residuals 2.084E-20 91 2.29E-22 
Total 1,899E-18 93 2.042E-20 


(Note: Taking the first differences of the original data set reduces the 
number of data points from 94 to 93.) 


® See Appendix Note # 37 
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Fig. 2 - Residuals from quadratic fit to phase 
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Coefficient of simple determination 0.9605 


Parameters: 


b = 1.049E-10 (sec/sec) t-ratio = 3,32 


Dr = -7.635E-16 (sec/sec2) t-ratio = -4.70 
Std. Error = 0.1624E-16 (sec/sec?) 


While the drift rate estimates for the two regressions are comparable in value 
(-7.507E-16 and -7.635E-16), the standard errors of the drift estimates have 
gone from 0.052E-16 to 0.162E-16 (a factor of 3). The linear regression's coef- 
ficient of simple determination is 96.05% compared to 99.17% for the quadratic 
fit. Figure 3 shows the residuals from the linear fit and they appear more 
nearly white. A cumulative periodograal4] is a more objective test of white- 
ness, however. The periodogram, Fig. 4, does not find the residuals acceptable 
at all. 


IV, DRIFT AND RANDOM WALK FM 

In the absence of noise, the second difference of the phase would be a constant, 
Dr+to2. If one assumes that the second difference of the noise part is white, 
then one has the classic problem of estimating a constant (the drift term), in 
the presence of white noise (the second difference of the phase noise). Of 


course, the optimum estimate of the drift term is just the simple mean of the 
second difference divided by Toe The results are summarized below, Table 4: 


TABLE 4, SIMPLE MEAN OF SECOND DIFFERENCE PHASE 


Simple mean Br = -6.709E-16 teratio = -2.45 

Degrees of Freedom = 91 

Standard Deviation § = 26.2405E-16 

Standard Deviation of the Mean = 2.7358E-16 
Figure 5 shows the second difference of the phase after the mean was subtracted. 
Visually, the data appear reasonably white, and the periodogram, Fig. 6, cannot 
reject the null hypothesis of whiteness. Now the standard error of the drift 
term {s 2.735E-16, 52 times larger than that computed for the quadratic fit! 
Indeed, the estimated drift term is only 2.45 times its standard error. 
ve SUMMARY OF TESTS 
The analyses reported above were all performed on a single data set. In order 
to verify any conclusions, all three analyses used above were performed a total 


of four times on four different data sets from the same pair of oscillators. 
Table 5 summarizes the results: F 


557 
TN-270 


4.99x 107 


Yn 


558 


-3.36 x10! 


93 


RUNNING TIME (HOURS) 


Fig. 3 - Frequency residual 
(lst diff-lin) 


TN-271 


€L7-NL 


6SS 


09S 


100% 


CUMULATIVE PERIODOGRAM 


50% 


90% CONFIDENCE INTERVALS 


° 
° A iz P| 4 Ss 
FREQUENCY (CYC/HR) 
Fig. 4 - First diff - linear 
8.16 x10715 
Sec/Sec® 
-7.59x10°15 


° 92 
RUNNING TIME (HOURS) 
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TABLE 5. 
(Units of 1.E-16 sec/sec2) 


SUMMARY OF DRIFT ESTIMATES 


ESTIMATION COMPUTED PASS 

PROCEDURE DRIFT STANDARD WHITENESS 

& MODEL ESTIMATE ERROR TESTS? 

Quad Fit -7.507 0523 No 

(White PM 

and Drift) 8.746 20493 No 
6.479 +0645 No 
6.468 +0880 No. 

Ist Difference -7.635 +162 No 

Linear Fit 

(White FM 8.558 +206 No 

and Drift) 
76.443 2192 No 
76.253 +295 No 
6.710 2.736 Yes 

Second Difference 

Less Mean -7.462 9.335 No 

(Random Walk 

FM and Drift) 6.870 3.424 Yes 
76.412 3.543 Yes 


One can calculate the sample means and variances of the drift estimates for each 
of the three procedures listed in Table 5, and compare these “external” estimates 
with those values listed in the table under “Computed Standard Error,” the 
“internal” estimates. Of course the sample size is small and we do not expect 
high precision in the results, but some conclusions can be drawn. The compari- 
sons are shown in Table 6. 


It is clear that the quadratic fit to the data displays a very optimistic inter- 
nal estimate for the standard deviation of the drift rate. Other conclusions 
are not so clear cut, but still some things can be said. Considering Table 5, 
the “2nd Diff - Mean” residuals passed the whiteness test three times out of 
four. The external estimate of the drift standard deviation lies between the 
internal estimates based on the first and second differences. Since the oscil- 
lators under test were crystal oscillators, one expects flicker FM to be present 
at some level. One also expects the flicker FM behavior to lie between white FM 
and random walk FM. This may be the explanation of the observed standard devia- 
tions, noted in Table 6. 
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TABLE 6. STANDARD DEVIATIONS 


EXTERNAL ESTIMATE 
(Std. Dev. of Drift 


INTERNAL ESTIMATE 
(RMS Computed Std. 


PROCEDURE Estimates from Col. Dev. Col. #3, 
(Model) #2, Table 5) Table 5) 
Quad Fit (White PM) 1.08 0.065 
Ist Diff - Lin 1.08 0.203 
(White FM) 
2nd Diff - Mean 0.44 5.45 


(Rand WLk FM) 


VI. DISCUSSION 


In all three of the analysis procedures used above, more parameters than just 
the frequency drift rate were estimated. Indeed, this is generally the case. 
The estimated parameters included the drift rate, the variance of the random 
(white) noise component, and other parameters appropriate to the specific model 
(e.g., the initial frequency offset for the first two models). If these other 
parameters could be known precisely by some other means, then methods exist to 
exploit this knowledge and get even better estimates of the drift rate. The 
real problems, however, seem to require the estimate of several parameters in 
addition to the drift rate, and it is not appropriate to just ignore unknown 
model parameters. 


To this point, we have considered only three, rather ideal oscillator models, 
and seldom does one encounter such simplicity. Typical models for commercial 
cesium beam frequency standards include white FM, random walks FM, and frequency 
drift. Unfortunately, none of the three estimation routines discussed above are 
appropriate to such a model. This problem has been solved in some of the recent 
work of Jones and Tryon(5],(6), Their estimation routines are based on Kalman 
Filters and maximum likelihood estimators and these methods are appropriate for 
the more complex models. For details, the reader is referred to the works of 
Jones and Tryon. 


Still left untreated are the models which, in addition to drift and other noises, 
incorporate flicker noises, either in PM or FM or both. In principle, the 
methods of Jones and Tryon could be applied to Kalman Filters which incorporate 
empirical flicker models 7). To the author's knowledge, however, no such analy- 
ses have been reported. 

VII. CONCLUSIONS 


There are two primary conclusions to be drawn: 


(1) The estimation of the linear frequency drift rates of oscillators 
and the inclusion of realistic confidence intervals for these 


563 
TN-276 


estimates are critically dependent on the adequacy of the model 
used and, hence the adequacy of the analysis procedures. 


(2) The estimation of the drift rate must be carried along with the 
estimation of any and all other model parameters which are not 
known precisely from other considerations (e.g., initial fre- 
quency and time offsets, phase noise types, etc.) 


More and more, scientists and engineers require clocks which can be relied on to 
maintain accuracy relative to some master clock. Not only is it important to 
know that on the average the clock runs well, but it is essential to have some 
measure of time imprecision as the clock ages. For example, the uncertainties 
might be expressed as, say,, 90% certain that the clock will be within 5 micro- 
seconds of the master two weeks after synchronization. Such measures are what 
statisticians call “interval estimates" (in contrast to point estimates) and 
their estimations require interval estimates of the clock’s model parameters. 
Clearly, the parameter estimation routines must be reliable and based on sound 
measurement practices. Some inappropriate estimation routines can be applied 
to clocks and oscillators and give dangerously optimistic forecasts of 
performance. 
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APPENDIX A 
where four quantities must be calculated from the data: 


REGRESSION ANALYSIS 


(Equally Spaced Data) — 4 es — ; 4 
We begin with the continuous model equation: nal n=] 
X(t) = a + bee + crt? + g(t) (Al) a 
We assume that the data is in the form of discrete readings of the dependent Sox * ) a Sxx = J Xp? 
variable X(t) at the regular intervals given by: n=l nel 
t = nto (a2) Define 
Equation (Al) can then be written in the obvious form: * 
Xq = @ + To ben + toz con? + O(NT>) (a3) (ie 
for n= 1, 2, 3 «e+, Ne c 
Next, we define the matrices: With these definitions, Eq. A3 can be rewritten in the matrix form: 
E ai X x = B22 * © (a4) 
1 2 & X) and the coefficients, B, which minimize the squared errors are given by: 
1 3 8 X3 a 
il is ae “e pa 8 =| 6] =2- Cum y+ cmx) (AS) 
6 6 * é 
1 oN Ne Xy The advantage of evenly spaced data for these regressions is that, with a bit of 


algebra, the matrix, ( N'N )71, can be written down in closed form: 


A B c 
om 9 Cnty -l = | B D oO: © LPs (a6) 
0 0 to2 c E F 
where 
N N 
A=3 (3 (N+1) +2 
tx, eS " (3 (N +1) + 2] 
1 i B= -18 (2N + 1) 
N N c= 30 
(NT)'X = | to] Xn = T°] Yxon| = 2°] Sox 
1 1 D = 12 (2N + 1) (8N + 11) / [(N + 1) (N+ 2)) 


z 

z 
m 
# 


-180 / (N + 2) 


™ 
] 


180 / [(N + 1) (N + 2)] 
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and 


where the coefficients A, B, C, etc., are given by: 
G=N(N- 1) (N - 2) 
A 


3 [3N (N+ 1) + 2] 
Also, the inverse of T is just: 
Bo = -18 (2N + 1) 


1 0) 0 
c = 30 
rio.» ti) Wt 0 
0 0 1 to2 D = 12 (2N +1) (8N +411) / [(N + 1) (N + 2)) 
° 


E = -180 / (N+ 2) 


The complete solution for the regression parameters can be summarized as follows: F = 180 / [(N + 1) (N + 2)] 


There are four quantities which must calculate from the data: 


and 
N " ; G = N(N- 1) (N= 2). 
Sx = JX Sonx = 2 Xan In matrix form, the error variance for forecast values 1s: 
n=l n=l 
Var (Xj) = 62 (1 + Ne? (NIND7! Ny] 
¢ s ; Xan s fe Xq2 where Ny' = [1 mp no] and to no is the date for the forecast point, hes That 
nx at xx wet is, Ng = N+ K and K is the number of lags past the last data point at lag N. 


for n= 1, 2, 3, «++, Ne» Based on these four quantities, the regression param 
eters are calculated from the seven following equations: 


= (A Sx + to B Spx +t" © Sanx) / 6 


o> 


B= (BS + 19D Sax + to” E Snnx) / (G to) 

* 2 2 

c= (C8 +5 2 Say +1. F Sanz) / (6 to ) 

Ble (Seg, Rhy = ty Bsig = 457 Shane) 1 C= 9) 
Gaz = G2 A/G 

Spt = 62 D/ (G to2) 


Ge? = 62 F/ (G to4) 
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APPENDIX B 


REGRESSIONS ON LINEAR AND CUBIC FUNCTIONS Ho = 360 (2N + 1) (9N + 13) /L 
I = -4200 (N+1)/L 
The matrixes (utnya} for the linear fit and cubic fit, which correspond to Eq. 
A6 in Appendix A are as follows: J = 2800/1 
For the linear fit: and 
A B K =N (N= 1) (N - 2) (N - 3) 
(N'N)7} = 1/o 
B c L = (N+ 1) (N + 2) (N+ 3). 
where The restrictions on these equations are that the data is evenly spaced begin- 
ning with n= 1 to n= N, and no missing values. For error estimates (and their 
A = 2 (2N +1) distributions) to be valid, the residuals must be random, uncorrelated, (i.e., 
white). 
Bos -6 
Cc = 12 / (N+1) 
and 
D= N(W-1)) 


For the cubic fit: 


> 
ow 
a 
o 


B E F G 

-1* izz 
(N'N) 4 ‘ e t 
D G I J 


where 
A = 8 (2N +1) (N +N + 3) 
B = -20 (6N2 + 6N + 5) 
C = 120 (2N + 1) 
D = 140 
E = 200 (6N4 + 27 N3 + 42 N2 + 30 N4 11) /L 
F = -300 (N+ 1) (3N + 5) (3N +2) /L 


G = 280 (6N2 + ISN + 11) /L 
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QUESTIONS AND ANSWERS 


MR. ALLAN: 


We have found the second difference drift estimator to be useful for 
the random walk FM process. One has to be careful when you apply it, 
because if you use overlapping second differences, for example, if 
you have a cesium beam, and you have white noise FM out to several 
days and then random walk FM beyond that point, and you are making 
hourly or 2 hour measurements, if you use the mean of the second 
differences, you can show that all the middle terms cancel, and in 
fact you are looking at the frequency at the beginning of the run and 
the frequency at the end of the run to compute the frequency drift and 
that's very poor. 


DR. BARNES: 


My comment would be: There again the problem is in the model, and not 
in the arithmatic. The models applied here were 3 very simple models, 
very simple, simpler than you will run into in life. It was pure random 
walk plus a drift or pure frequency noise plus a drift, or pure random 
walk of frequency noise plus a drift and it did not approach at all any 
of the noise complex models where you would have both white frequency and 
random walk frequency and a drift. That's got to be handled separately, 
I'm not even totally sure how to perform it in all cases at this point. 


UNCERTAINTY. 
UNCERTAINTY, 
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MR. McCASKILL: 


I would like to know if you would comment on the value of the sample time 
and the reason why, of course, is that the mean second difference does 
depend on the sample time? For instance, if you wanted to estimate the 
aging rate or change in linear change of frequency, what value of sample 
time would you use in order to make that correction. So, really, the 
question is, how does the sample time enter into your calculations? 


DR. BARNES: 


At least I will try to answer in part. I don't know in all cases, I'm 
sure, but if you have a complex noise process where you have at short 
term different noise behavior than in long term, it may benefit you to 
take a longer sampling time and effectively not look at the short term, 
and then one of the simple models might apply. I honestly haven't 
looked in great detail at how to choose the sample time. It is an 
interesting question. 
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MR. McCASKILL: 


Well, let me go further, because we had the benefit of being out at 

NBS and talking with Dr. Allan earlier and he suggested that we use 

the mean second difference, and the only problem is if we want to 
calculate or correct for our aging rate at a tau of five days or ten 
days, and you calculate the mean second difference, you come up with 
exactly the Allan Variance. What appears is that in order to come up 
with the number for the aging rate, you have to calculate the mean 
second difference using a sample time whenever you take your differences 
of longer than, let's say, ten days sample time. So we use, of course, 
the regression model, but we use on the order of two or three weeks in 
order to calculate an aging rate correction for, say, something like the 
rubidium in the NAVSTAR 3 clock. It looks like in order to come up 
with a valid value for the Allan Variance of five or ten day sample 
time you have to calculate the aging rate at a longer, maybe two or 
three times longer sample time. 


DR. BARNES: 


Dave Allan, do you think you can answer that? 


MR. ALLAN: 


Not to go into details, but if you assume that in the longer term you 
have random walk frequency modulation as the predominant noise process 
in a clock, which seems to be true for rubidium, cesium and hydrogen, 
you can do a very simple thing. You can take the full data length 
and take the time at the beginning, the time in the middle and the 
time in the end and construct a second difference, and that's your 
drife. 


There is still the issue of the confidence interval on that. If you 
really want to verify your confidence interval, you have to have enough 
data to do a regression. You need enough data to test to be sure the 
model is good. 


DR. WINKLER: 


That argument is fourteen years old, because we have been critized 
here. I still believe that for a practical case where you depend on 
measurements which are contaminated and maybe even contaminated by 
arbitrarily large errors if they are digital. These, theoretical 
advantages that you have outlined may not be as important as the 
benefits which you get when you make a least square regression. In 
this case you can immediately identify the wrong data. Otherwise, if 
you put the data into an algorithm you may not know how much your data 
is contaminated. So for practical applications, the first model even 
though theoretically it is poor, it still gives reasonable estimates 
of the drift and you have residuals which let you identify wrong phase 
values immediately. 
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DR. BARNES: 


I think that's true and you may have different reasons to do regression 
analysis, if your purpose is to measure a drift and understand the 
confidence intervals, then I think what has been presented is reasonable, 
if you have as your purpose to look--to see if there are indications of 
funny behavior in a curve that has such strong curvature or drift that 
you can't get it on graph paper without doing that, I think it is a very 
reasonable thing to do. I think looking at the data is one of the 
healthiest things any analyst can do. 
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VARIANCES BASED ON DATA WITH DEAD TIME BETWEEN THE MEASUREMENTS 
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The accepted definition of frequency stability in the time domain is 
the two-sample variance (or Allan variance). It is based on the 
measurement of average frequencies over adjacent time intervals, 
with no “dead time" between the intervals. The primary advantages 
of the Allan variance are that (1) it is convergent for many 
encountered noise models for which the conventional variance is 
divergent; (2) it can distinguish between many important and 
different spectral noise types; (3) the two-sample approach relates 
to many practical implementations; for example, the rms change of an 
oscillator'’s frequency from one period to the next; and (4) Allan 
variances can be easily estimated at integer multiples of the sample 
interval, 


In 1974 a table of bias functions which related variance estimates 
with various configurations of number of samples and dead time to 
the Allan variance was published [1], The tables were based on 
noises with pure power-law spectral densities. 


Often situations occur that unavoidably have dead time between 
measurements, but still the conventional variances are not 
convergent. Some of these applications are outside of the time-and- 
frequency field, Also, the dead times are often distributed 
throughout a given average, and this distributed dead time is not 
treated in the 1974 tables. 


This paper reviews the bias functions B,(N,r,u), and B,(r,y) and 
introduces a new bias function, B,(2,M,r,u#), to handle the commonly 
occurring cases of the effect of distributed dead time on the 
computed variances, Some convenient and easy-to-interpret 
asymptotic limits are reported. A set of tables for the bias 
functions are included at the end of this paper. 


Key words: Allan variance; bias functions; data sampling and dead 
time; dead time between the measurement; definition of frequency 
stability; distributed dead time; two-sample variance 


1, Introduction 


The sample mean and variance indicate respectively the approximate magnitude 
of a quantity and its uncertainty. For many situations a continuous function 
of time is sampled, or measured, at fairly regular intervals. Sampling is not 
always instantaneous. It takes a finite time and provides an "average 
reading." If the underlying process (or noise) is random and uncorrelated in 
time, then the fluctuations are said to be “white” noise. In this situation, 


the sample mean and variance calculated by the conventional formulas, 


N 
1 - 
a= Fyne 
n=l 


qQ) 
N 


=a LG.-m. 
n=1 


provide the needed information. The “bar” over the y in eq (1) above denotes 
the average over a finite time interval, In time and frequency work, y is 
defined as the average fractional (or normalized) frequency deviation from 
nominal over an interval + and at some specified measurement time. As in 
science generally, the physical model determines the appropriate mathematical 
model. For the white noise model, the sample mean and variance are the 


mainstays of most analyses. 


Although white noise is a common model for many physical processes, more 
general noise models are being identified and used. In precise time and 
frequency measurement, for example, there are two quantities of great 
interest: instantaneous frequency and phase. These two quantities by 
definition are exactly related by a differential. (We are NOT considering 
Fourier frequencies at this point.) That is, the instantaneous frequency is 
the time rate of change of phase. Thus, if we were employing a model of white 
frequency-modulation (white FM) noise, then the phase noise is the integral of 
the white FM noise, commonly called a Brownian motion or random walk. 
Therefore, depending on whether we are currently interested in phase or 
frequency, the sample mean and variance may or may not be appropriate. 
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By definition, white noise has a power spectral density (PSD) that is constant 
with Fourier frequency. Since random walk noise is the integral of white 
noise, the power spectral density of a random walk varies as 1/f* (where f is 
the Fourier frequency) [2]. We encounter noise models whose power spectral 
densities are various power laws of their Fourier frequencies. Flicker noise 
is very common and is defined as a noise whose power spectral density varies 
as 1/f over a relevant spectral range. If an oscillator’s instantaneous 
frequency is well modeled by flicker noise, then its phase would be the 
integral of the flicker noise. It would have a PSD which varied as 1/f*. 


Noise models whose PSD's are power laws of the Fourier frequency but not 
integer exponents are possible as well but not as common. This paper 
considers power-law PSD's of a quantity y(t); y(t) is a continuous sample 
function which can be measured at regular intervals. For noises whose PSD's 
vary as f* with a < -1 at low frequencies, the conventional sample mean and 
variance given in eq (1) do not converge as N gets large [2, 3]. This lack of 
convergence renders the sample mean and variance ineffective and often 


misleading in some situations, 


Although the sample mean and variance have limitations, other time-domain 
statistics can be convergent and quite useful. The quantities that we 
consider in this paper depend significantly on the details of the sampling 
procedures. Indeed, each sampling scheme has its own bias, and this is the 
motivation for the bias functions discussed in this paper. 


2, The Allan Variance 


Recognizing that for particular types of noise, the conventional sample 
variance fails to converge as the number of samples, N, grows, Allan suggested 
that we set N = 2 and average many of these two-sample variances to get a 
convergent and stable measure of the spread of the quantity in question [3]. 
This is what has come to be called the Allan variance. 


More specifically let us consider a sample function of time as indicated in 
figure 1. A measurement consists of averaging y(t) over the interval r. The 
next measurement begins at a time T after the beginning of the previous 
measurement interval. There is no logical reason why T must be as large as r 
or larger--if T <1, then the second measurement begins before the first is 
completed, which is unusual but possible. When T = 1, there is no dead time 


between measurements. 


The accepted definition of the Allan variance is the expected value of a two- 
sample variance with no dead time between successive measurements, In 


symbols, the Allan variance is given by 
oF (7) = HEL (nei "Ya? I), (2) 


where there is no dead time between the two sample averages for the Allan 


variance and the E[+] denotes the expectation operator. 
3. The Bias Function B, (N,r,#) 


Define N to be the number of sample averages of y(t) used in eq (1) to 
estimate a sample variance (N = 2 for an Allan variance). Also define r to be 
the ratio of T to r (r = 1 when there is no dead time between measurements). 
The parameter » is related to the exponent of the power law of the PSD of the 
process y(t). If a is the exponent in the power-law spectrum for y(t), then 
the Allan variance varies as 7 raised to the yw power, where a and pw are 
related as shown in figure 2 [2-4]. We can use estimates of » to infer a, the 
spectral type. The ambiguity in a for w = -2 has been resolved by using a 
modified o2(r) [5-7]. 


Often data cannot be taken without dead time between sample averages, and it 


is useful to consider other than two-sample variances. We will define the 


bias function B,(N,r,u) by the ratio, 


2 
Bre) = SRO , @) 


o 


TN-299 


where o?(N,T,r) is the expected sample variance given in eq (1) and based on N 
measurements at intervals T and averaged over a time r and r = T/r. In words, 
B,(N,r,4) is the ratio of the expected variance for N measurements to the 
expected variance for two samples (everything else held constant). The 
variances on the right in eq (3) depend implicitly on the noise type even 
though 4 or a are not shown as independent variables. The noise-type 
parameter, 4, is shown as an independent variable for all of the bias 
functions in this paper, because the values of the ratio of these variances 
explicitly depend on » as will be derived later in the paper. Allan showed 
that if N and r are held constant, then the a, yw relationship shown in figure 
2 is the same; that is, we can still infer the spectral type from the r 
dependence using the equation a = -p-1, -2 < yw < 2 [3). 


4. The Bias Function B,(r,p) 


The bias function B,(r,u) is defined in [1] by the relation, 
a OPT F) othe Ter: 
B(r,p4) = 2,4,7) => ; (4) 


In words, B,(r,y) is the ratio of the expected two-sample variance with dead 
time to that without dead time (with N = 2 and r the same for both variances). 
A plot of the B,(r,y) function is shown in figure 3. The bias functions B, 
and B, represent biases relative to N = 2 rather than infinity; that is, the 
ratio of the N sample variance (with or without dead time) to the Allan 
variance and the ratio of the two-sample dead-time variance to the Allan 


variance respectively. 
5. The Bias Function B,(N,M,r,p) 


Consider the case where a great many measurements are available with dead time 
between each pair of measurements (T, > 1,). The measurements are averaged 
over the time interval r,, the spacing between the beginning of one 
measurement to the next is T,, and it may not be convenient to retake the 
data. We might want to estimate the Allan variance at, say, multiples M of 

Ly] 


the averaging time r,. If we average groups of the measurements of y(t), then 
the dead times between the original measurements are distributed periodically 


throughout the new average measurements (see figure 4). Define 


M+i-1l 


Y= oC oy Yn (5) 


where ¥, are the raw or original measurements based on dead time Ty-19. 
Also define the two-sample variance with distributed dead time as 

o2(2,M,T,7) = HEL -Yyen)?] (6) 
with r = Mr, and T = MT,. 


We can now define B, as the ratio of the N-sample variance with distributed 
dead time to the N-sample variance with dead time accumulated at the end as in 


figure 1: 
2 iN M,T, +r) 
By (N,M,r,u) = ot(N, Tir) * (7) 


Although B,(N,M,r,u) is defined for general N, the tables in the Appendix 
confine treatment to the case where N= 2. There is little value in extending 
the tables to include general N. Though the variances on the right in eq (7) 
depend explicitly on N, T and r, the ratio B,(N,M,r,u) depends on the ratio 
r= T/r, and on » as developed later in this paper. 


In words, B,(2,M,r,u) is the ratio of the expected two-sample variance with 
periodically distributed dead time, as shown in figure 4, to the expected two- 
sample variance with all the dead time grouped together as shown in figure 1. 
Both the numerator and the denominator have the same total averaging time and 
dead time, but they are apportioned differently. The product B,(r,u) + 
B,(2,M,r,u) is the distributed dead-time variance over the Allan variance for 


a particular T, r, M and p. 
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Some useful asymptotic forms of B, can be found. In the case of large M and 
M> xr, we may write that 


a, = its Asp s 2, 


(8) 


4 In(2 
By = Dann) + 3° 


w=. 

One simple and important conclusion from these two equations is that for the 
cases of flicker FM noise and random-walk FM noise, the r“ dependence for 
large r is the same whether or not there is periodically distributed dead 
time. The values of the variances differ only by a constant, and in the 
latter case the constant is 1. This conclusion is also true for white FM 
noise, and in this case the constant is also 1. 


's x» 1 and -2 < ws -1, we may write for the asymptotic behavior 


By =M*, a= -p-1, (9) 


as was determined empirically. In this region of power-law spectrum the B, 
function has an M* dependence for an f* spectrum. 


6. The Bias Functions 
The bias functions can be written fairly simply by first defining the 
function, 


F(A) = 2a"t? - (A + 1)4*? - [(A - 1)]**?. (10) 


The bias functions become 


N-1 N-n 
1+ + F(nr) 
Bry) = —=P Be ; a 
7 


1 SF 
Blea) = Se (2) 


as given in [1], and 


M-1 
2M + M-eF(Mr) - J (M-n)[2F(nr)-F((M#n)r) -F((M-n)r)] 
By (2,M,r,4) = ———_ For 72] » =K13) 


as indicated in the appendix. 


For p = 0, eqs (11), (12), and (13) are the indeterminate form 0/0 and must be 
evaluated by l’H6pital’s rule. Special attention must also be given when 
expressions of the form 0° arise, We verified a random sampling of the table 
entries using noise simulation and Monte Carlo techniques. No errors were 
detected. The results in this paper differ some from those in [8], which 
suggests that there may be some mistakes. Tables for the three bias functions 
are listed at the end of the paper (note that the computer print-out did not 


have a symbol for Greek mu 


h). 
7. Examples of the Use of the Bias Functions 


The spectral type, that is, the value of w, may be inferred by varying 7, the 
sample time. However, another useful way of determining the value of yw is by 
using B,(N,r,u) as follows: calculate an estimate of o3(N,T,1r) and 02 (2,T,r) 


and hence B,(N,r,u); then use the tables to infer the value of yz. 
Suppose one has an experimental value for o}(N,, T,, 7,) and its spectral 
type is known, that is, » is known. Suppose also that one wishes to know the 


variance at some other set of measurement parameters, N,, T,, r2. An unbiased 


estimate of o2 (N, .T2.72) may be calculated by the equation: 
o2(N,,T2,72) = (2) ( Nest H)B2 (E204) ) gq, ty sry) (14) 


r By (Ny; 5H) By (Fy «H) 


where r, = T,/r, and rz = T3/r2. 
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Since the time-domain definition for frequency stabi)ity is the Allan 
variance, it behooves us, where possible, to relate other variances to the 
Allan variance. If we have an N-sample variance on data with dead-time T-r 


and we know the power-law spectral type (the value of »), then we may write 


o2 (N,T.r 


B, (Nr ,n) By (Fn) (8) 


2 “é 
oy (r) = 
If we have an N-sample variance where each data entry is an average of M 


samples with distributed dead time, then we may write 


o2(N.M. Tor 


By Wr.) B, (rn) By(NME nD 8 


oF (r) = 


8. Conclusion 


For some important power-law spectral density models often used in 
characterizing precision oscillators (S,(f) ~ £*, a= -2, -1, 0, +1, +2), we 
have studied the effects on variances when there is dead time between the 
frequency samples, and the frequency samples are averaged to increase the 


integration time, Since dead time between measurements is a common problem 


throughout metrology, the analysis here has broader applicability than just to 


time and frequency. Specifically, this kind of analysis has been used with 
gage blocks and standard volt cells--showing that the classical variance may 


be non-convergent in some cases [9]. 


Heretofore, the Allan variance has been shown to have some convenient 
theoretical properties in relation to power-law spectra as the integration or 
sample time is varied (if oy? (r) ~ r#, thena = -w -l, -2 <p 2). Since 
o,(r), by definition, is estimated from data with no dead time, the sample or 


integration time can be unambiguously changed to investigate the + dependence. 


From our analysis, we have concluded that for the asymptotic limit of several 


samples being averaged with dead time present in the data, the r dependence of 


the variances is the same. The a = -y -1 relationship still remains valid for 


white FM noise (u = -1, a = 0), flicker FM noise (u = 0, a = -1), and for 
s 
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random-walk FM noise (4 = +1, a = -2). The asymptotic limit is approached as 
the product of number of samples averaged and the initial data sample time, 
tT), becomes larger than the dead time (M>r). The variances so obtained 


differ only by a constant, which can be calculated as given in this paper. 


A knowledge of the appropriate power-law spectral model is required to 

translate a distributed dead-time variance to the corresponding value of the 
Allan variance. In principle, the power-law spectral model can be estimated 
from the r* dependence, using the variance analysis on the data as outlined 


above. 
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Table 1. Table of some bias function identities 


Standards Metrology?" IEEE Trans. on Instrumentation and Measurement, BENZ ee) Be 
IM-36, 646-654, 1987. BuAnsah bd SS 
B, (N,1,1) =N/2 
B,(N,1,4) = (N(1-N*))/[(2(N-1)(1-2)] for pO 
= N In(N)/[2(N-1) 1n(2)] for y=0 
B,(N,1,) =1 for p<0 
N-1 
= [2/(N(N-1)] J (N-n) + m for p> 0 
n=l 
B, (N,r,-1) =lifre1 
B, (N,r,-2) =1lifr#i1or0 
B, (0,4) =0 
B, (1,4) bal 
B, (r,2) Ce oa 
B, (r,1) = (3r - 1)/2 tf rel 
B,(r,-1) =rifOsr<1 
=lifre2i1 
B, (r,-2) = 0 if r=0 
=1 if r=1 
= 2/3 otherwise 
By (2,M,1,p) =1 
B,(2,M,r,-2) =M 
By (2,r,n) =1 
B; (2,M,r,2) =i 
B,(2,M,r,-1) =lforr21 
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TWO MEASUREMENTS OF A SET WITH DEAD TIME 


Illustration of two fractional frequency samples with dead time, T-r, between the samples, 


This is two of a set of adjacent frequency measurements, each averaged over an interval r, needed 


to calculate a two-sample variance from a data set. 


Figure 1. 
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Figure 2. A plot of the relationship between the frequency-domain power-law 
spectral-density exponent a and the time-domain two-sample Allan variance 
exponent yp (a = -w-1, -2 << 2 anda2i for w= -2). Also shown is the 
similar relationship between a and the modified Allan variance with exponent 
ont of p’ (@ = -p'-1, -4 <p’ < 2). The pointing arrows indicate the mu- 
alpha relationship (a vs. w or w') for which the particular variance applies. 
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Illustrations with M = 4 
Distributed Dead Time = 4 + (Tp—ro) 
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TWO AVERAGES WITH FOUR MEASUREMENTS 
EACH FROM A SET WITH DEAD TIME 


Figure 4. An illustration of determining two averages, each taken over four measurements. In this 
illustration the original data have a sample time r, and a dead time T, - r,. The two averages each have a 
distributed sample time 4r, = r, and a distributed dead time 4(T, - r,) = T - +, since in this case M = 4. 
These two averages are two of a set similar averages with distributed sample times and dead times needed to 
calculate a two-sample distributed sample-time and dead-time variance -- the numerator for the bias function 
B,. The denominator for B, is a two-sample variance with no distributed sample time or dead time but with T = 
MT, and r = Mr, and dead time T - r. 


PF is S(M) = 4-M-R(O) - 4-M-R(r) - 2-M-G(MT) 
With reference to figure 1, the frequency sampling window has an equivalent M-1 
phase sampling window. The intent is to evaluate the variance, S(M), of the +2 YY (M-n)[2-G(nT) - G((M#n)T) - G((M-n)T)]. 
sampled phase function in terms of the phase autocorrelation function, R(r). 


The process here is to correctly account for terms and cross-terms coming from 
Following the work of Barnes and Allan [2,3], we can define the function U(r) 


squaring and averaging the samples for each M. The B,(2,M,r,u) function can 
by the relation, 


then be obtained from the relation, 


U(r) = 2-R(O) - 2-R(r), 
By(2,M,r,u) = ih, 
S(1) Met? 
and also define 


for appropriate M, r, and wu. The denominator is just the two-sample variance 


with dead time for MT and Mr (in accordance with the definition of F(nr) = G(nT)/U(r), 

B,(2,M,r,#)). The factors common to the numerator and denominator are ignored 

in the following. where r = T/r. The function U(r) for power-law power spectral densities has 
the form, 


For M = 1, the variance S(1) is just 
rie" 
S(1) = 4-R(0) - 4-R(r) - 4-R(T) + 2-R(T+r) + 2R(T-r), U(r) = —saaeee 
4-2"* 


where use has been made of the definition of the autocorrelation function, 
which yields 


BORD = BURKE) * RES) Dy F(nr) = 2-(nr)#*? - (nr#1)#*? -ynr-1]4*?. 


It is convenient to define a function G(T) as 
Finally, the working relation can be written as 


G(T) = 2-R(T) - R(T+r) - R(T-r). 


M-1 
Similarly, S(2) can now be written in the form, 2-M + M-F(Mr) =k, Caen [2-F(mr) - F((M+n)r) - F((M-n)r)) 
By (2,M,r,p) = 


(2 + F(r)) + met? 
S(2) = 8-R(O) - 8-R(r) + 2-G(T) - 4-G(2T) - 2-G(3T). 


Following this procedure, we can verify that the general S(M) is just 
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6. 054E+00 
1. 145E+01 
2. 167E+O1 
4, 041E+O1 
7. 20E+01 
1,247E+02 
1. 9766902 
2. 857E+02 
3, 763802 
4.572002 
‘5.221802 
5. 708E+02 
6. 066E#02 
6. SH0E+02 
6, S3E+02 
6, OB8E+02 
6.819E02 
6. 9E0? 


‘S.M1E+01 
6. S24E +01 
1.259%? 
1, 748E+02 
2. 2BsE*02 
2.85E+02 
3.57202 
3. 8B7E+02 
4, BE? 
4, 067E02 
5. R202 
S.851E+02 
8.02 
6. TREO? 


12 


1,.000E+00 
2. 0B9E+00 
4, 440E+00 
9. S00E+00 
2.026E+01 
4.25501 
B.691E+01 
1.697E+02 
3. 106E+02 
5.220802 
7.951E2 
1.097E+03 
1, 390E+03 
1, 649E+03 
1,869E+03 
2.055E403 
2.215E+03 
2. 359E+03 
2,49%E+03 
2.67303 
2. 7S2E+03 


1. S17E*03 
1, 348E+03 
1, 6158403 
1.930E+03 
2.308403 
2. 7S2E+03 


Be 


1,000E+00 
2. WED 
5.505% +00 
1.28201 
2.947E+01 
6.628640) 
1.4302 
2.992 
‘5.814402 
1,036E+03 
1.672603 
2, 446E+03 
3. 287E+03 
4.142E903 
4. 991E+03 
‘S.B42E+03 
6.717E+03 
7. GA0E+03 

}. O37E*03 
9. T37E#03 
1. 097E+04 


$12 1028 


1,0006+00 1. 000E+00 
2.43600 2.494810 
6,002E+00 6, 198E+00 
1.456601 1.532001 
3.480401 3, THE*O1 
B.190E+01 9. 064E+01 
1,068E+02 2, 137E+02 
4.076E+02 4. 851E+02 
8.357E+02 «1.043803 
1,SQ0E+03 2, 0B4E +03 
2. 7198903 = 3. 826E+03 
4.263503 6. 453E+03 
6.17HE+0S = 1, 014E +04 
B.A19EHOS 1, SIME 
1, 1048404 
124 
1, 782EH4 
2. 2ZUEO 
2.7908 
3.493004 1. 2318405 
A. TIEECOA 1. TIES. 


‘S12 

1, 000E +00 

2.010€+00 2. 015E+00 
4, 030€ +00 
8.044E +00 
1.SEOL 1.626801 
S.N27E*O1 3.229801 
6.02901 6, MIEHO 
1.1$MEO2 1.225802 
2.066602 — 2,314E+02 
3.619E+02 4, 2588402 
6.082E+02 7.611E+02 
9.GMECO2 1. 378E+03 
1.S41E+03 2.277803 
2.364E+03 3.868603 
3.SQ0E+O2 6. SHEHO3 
‘S. 3903 1.114808 
B.128E+03 = 1. 90304 
1.Z28E+04 3, 276408 
1.866E+04 — S.684E +04 
2.B49E+O4 9. 936E +04 
4. S7EECOA 1, TA9EH0S 


1 


1, 000E+00 
2.5120 
6. 0900 
1,S8SE+01 
3. O0E01 
1,000E+02 
2.519E902 
6.4702 
1. 715E+03 
‘5. SB1E+03 


1,008 +00, 
2.016E+00 


1. 651E+01 
3. E01 
6. 7706901 
1,.03E+02 
3. 0°9E +02 
8.S71E+02 


TN-314 


81(h,r mu) 


8. 065E+00 
|. BOMEHO0 
9. MSE HOO 
9.989600 
1.045E+01 
1.064 +01 
1. 118E+01 
1, 147E+O1 
1.174901 
1, 200€+01 


BIIN,r eu) 


1.000€+00 
4. 128E+00 
1, 24E+00 
1, 388E*O0 
1.527800 
1. O67E+00 
1. 06E+00 
1, 90386060 
2.076E00 
2.203900 
2.22% 
2, 4M0E +00, 
2. 550E+00 
2.64E +00 
2. TMECO 
2.852800 
2, 947E+00 
3.042+00 
3.1378 +00 
3.2¢E00 
3. EO 


fr rs ot 


1,000 +00, 
1, 438E+00 
2.021E+00 
2.832E+00 
3. 931E+00 
5.37500 
7. 204E+00 
9ATEOO 
11996401 
1.481E901 
1, TIE*O$ 
2.080801 
2. FEO 
2.663001 
2. 938E9Ot 
3.208801 
3.4630! 
3,721E+O1 
3. %62E*01 
4, 2528901 
4.53301 


for rs 3 


1, 925E 900 
2. 3S1E+00 
2. 8S0E+00 
2A 
4.122800 
4.92700 
5.87700 
7,0006+00 
8, S38E+00 
9, 9H0E 900 
1, 187E+01 
1, 4228401 
1.708601 
2.059401 


3. 0306401 
3.998401 
4. 533E+01 


R 


1, 000E +00 
1. S47E*OO 
2.329800 
3,477E+00 
5.1258+00 
7.42900 
1,05SE+01 
1, 461€+01 
1, 971€901 
2. 585E+0) 
3, 2008+0) 
4. 111E*01 
5.01SE+01 
6.014890) 
7. 118E+0) 
8. 347E+01 
9.728640) 
1, 1306+02 
1, R9E+02 
1, S17E*02 
1, 700E+02 


1.0006 +00 
1. 2658400 
1. SB¥E00 
1.9886 +09 
2.479 
3. 067Er0) 
3. BATE +00 
4, B04E+00 
6,.024E+00 
7.S97E+00 
9. OSIEOO 
1. 234E+01 
1.599601 
2.089E+01 
2. THEO! 
3.673001 
4. AZO 
6. 709E+01 
9. 1OSEOL 
1,.267E+02 
1, 7O0E +02 


cl 


1,000€+00 
1. S79E+00 
2.M9EH00 
3.772800 
5S. 7SIE+0O 
8, 6S3E+00 
1, 281€¢01 
1, 8596401 
2.042E+01 
3,673€+01 
5.0036+0) 
6.690E+01 
6.816640) 
1, 169E 902 
1, 487E+02 
1,958€+02 
2,470€ +02 
3. 183E+02 
4.113402 
5. 3308402 
6, 9336402 


1,006 +00 
1.265€+00 
1.594E+00 
2.00°€ +00 
2. SEO 
3.209€ +00) 
4, 093€ +00 
5.275800 
6. BBFESOH 
9. 147E#00 
1, 2386+! 
2.710801 
2.411E+01 
3.472801 
‘S.098E+01 
7.b18E+01 
1, 1S7E*OZ 
1, 7B1E+02 
2.774802 
4, 368E +02 
6.933002 


20 


128 


1,0006+00 
1, SB6EH00 
2.490E+00, 
3.892800 
6..048E+00 
9. N20 
1.419890) 
2.13701 
‘3. 177E+O1 
AME CO) 
6. 771E+01 
9. THEOL 
1.397902 
1. 99%E902 
2.862E+02 
4. 114E+02 
5.963E+02 
8. 630E+02 
1.2636+03 
1.658€+03 
2. 752E+03 


128 


1.000€ +00 
1.263600 
1, 594E +00 
2.014€ 900 
2.5888 +00, 
3. 271E+00 
4, 239000 
'S.595€+00 
7.SAE +00 
1.059E+1 
1.515801 
2, 260601 
2.ATEO 
‘S.SB1E*O1 
9, 187ESO1 
1, 552E+02 
2.078EO2 
4.20%? 
8, 3B1E+O? 
1.SL1E+03 
2.782003 


1,0006+00 
1. SB6E+00 
2.9026+00 
3. 938E+00 
6. 177E+00 
9. 6S2E+00 
1.02401 
2,326E+01 
3.592601 
S.S42E+01 
8. 564E+01 
1, 331E+02 
2.084602 
3.25402 
5.2696+02 
8.$23+02 
1, 394E+03 
2.248103 
3.B43E +03 
6.467E+03 
1,097E+04 


‘S.812E+00 
8. 0RGE+00 
1, 17SE*Ot 
1, 796E +O! 
2.897801 
4, 926E+01 
8. 786E +01 
1.632802 
3.132802 
6.170402 
1, 241€903 
2.59503 
5.205E003 
1.097E+04 


‘312 


1.0006 +00 
1. S85E+00 
2.505E+00 
2, 95NE+00, 
6. 2358 +00 
9. B2SE +00 
1. S80E+01 
2,.4S2E+01 
3.910640) 
6.314E+0) 
1.037E+02 
1, 741E+02 
2.99002 
5.26SE+02 
9, MObE +02 
1. 738403 
3.232003 
6, 1036403 
1, 168E #04 
2.2508 +04 
42H 


1.0006 +o 
1, 2618406 
LSE 
2.015600 
2.569800 
3.3196 +00 
4.3708 +00 
5. °SBE+00 
8. 4B7E +00 
1, 2826901 
2.07990! 
3.63280} 
6.822401 
1, SEO? 
2.87902 
6, 2920? 
1.419603 
2.272003 
7.67H003 
1.823404 
4. 378E+A 


1, 000E+00 
1, SB4E +00 
2.505E +00 
3, 9O0E+00 
6. 2606400 
9126900 
1.57701 
2,537E+01 
41536401 
6. 989E +01 
1. 2198902 
2.214€+02 
4, 1986602 
8, 254E+02 
1, 678E+03 
3. S00E +03 
7.483003 
1.613404 
3. S38E +04 
7. BI0E+04 
1, TA9E+05, 


4028 


1.0008 +00, 
1, 2616+00 
1 SP1E#00 
2.014E 00 
2.52000 
3, 320E+00 
4 EHO 
6, O5GE HO) 
8, 795E 200, 
1. I7TE+ 
2. EOL 
44796901 
9, I0E*OL 
2.103402 
S.037E+02 
1.261903 
3. 261E*03 
8.6318+03 
2.72 
6 MIO 
1.74965, 


1, 000E +00, 
1, 5B3E+00 
2. SOME +00 
3. 962E+00 
6,.278E+00 
1, 0006401 
1, 616E+01 
2, 702E+01 
4.922801 
4, 1506402 


La 


1,.0006+00 
1.260800 
1. S9E°00, 
2.01300 
2S 
4.333800 
4 MTEC 
6 EO 
9, 77690) 
2.017E9O1 


TN-315 


sin, oer 


1, 107E+00 
11726400 
1,247E+00 
1, 333+00 
1,432E+00 
1, SA4E+00 
1, 677E+00 
1, B27E+00 
2, 000E+00 
2. 198E+00 
2.426E+00 
2. 0BRE+O 
2, 9BRE +00, 
3. BE 


BUIN,r mu) 


1.0006 +04) 
9188-0) 
9.09801 
$. 2BE-01 
9.599E-01 
1.0006 +04 
1, 048E +0 
1. LONE +00 
1, 108E +00 
1.26380) 
1, 3298400 
1, 428E +00 
1. SLE*O0 
1.6726+00 
1.8226+0) 
1, 9956400 
2. 1948400 
2.4226+00 
2. 0B5E+H 
2. 9BGE +H 
3.3310) 


7.827E-01 
8.221€-01 
8. 700€-01 
9, 28E-01 
1.0006+00 
1, 0866+00 
L.197E+00 
1,3336+00 
1,502+00 
1. T14E+00 
1. 982E+00 
2. 3206400 
2. TS0E+00 
3.2998 +00 
4,.0006+00 
4.900610 
6, 059E+00 
7.5556+00 
PASE HOD 
1. 200€+01 


6.86E-01 
9. 231E-01 
4. 000E +00 
1. 0BSE+O0 
1, 1936400 
1. RTE 
1. 495SE +00 
1. 708E+00 
1. 9726900 
2, 9E+00 
2, 738E+00 
3.28500 
3. 985E+00 
4, BBSE+O0 
6, O4SE +00 
7. SAEOO 
9. AB2E00 
1, 200€ +01 


= © 


for r= 


we 


‘7. 0B3E-O1 
7.A3IE-O1 
7.BOAE-OL 
8. 4106-01 
9, 105E-O1 
1, 000€ +00 
1,11 7E+00 
1.271800 
1,476E+00 
1, THE+00 
2.1338+00 
(2. 658E+00 
3. 391E+00 
4.424E +00 
‘5.894800 
8.000E+00 
1, 10480! 
1, S48E 0! 
2.191E+01 
3.1301 
4.53% +01 


1, 000890 
A25E-O1 
20AE-OL 
8,S7%-01 
9, 1608-01 
1, 000E +00, 
1,113€400 
1, 265E 900 
1, 463E +00 
1, 743E +00 
2, 1208900 
2.042800 
3, I71EO 
4, 400E +00 
S.664€-00 
7.96GE+00 
1, 1006401 
1,201 
2. 1B7EOL 
3. 135E9O1 
4. S3KOL 


1.01 


3.471E+00 
4, BAGE+00 
7,.006E+00 
1,0456+01 
1, 600E +01 
2.508E+0) 
3, 999801 
6. 4796401 
1.0636 +02 
1, TOE +02 


6. 098E-01 
8. 4198-01 
9056-01 
1,000€ +00 
1, 1336400 
1, 3216400 
1,589E+00 
1, 9B0E+00, 
2.583000 
3. UATECOO 
4.BIME+OO 
6.9636 +00 
1,0396+01 
1, S93E+O1 
2.49701 
3, 988E+O1 
6. 486E+0! 
1, 062E+02 
1, 760E+02 


6. 771E-01 
7.122E-01 
T.SME-O1 
8. 154E-01 
8. 933E-01 
1,000 +00 
1, 150E+00 
1, 370E+00 
1. 700€+00 
2,216E+00 
3, 0486+00 
4.432E+00 
6, BO1E+00 
1.0966 +01 
1. BA1E+O1 
3.2006+01 
‘S.717E+01 
1, 084E+02 
1. 998E+02 
3.OMGE +02 
6. 933E+02 


1. 0006+00 
8. 217E-01 
8.009E-01 
6. 33%-01 
8, 995E-01 
1. 000E +00 
1. 147E+00 
1, 362E+00 
1, 689E+00, 
2.2006 +00 
3. 025E+00 
4 400E +00 
6. T4E+00 
1.0896+0) 
1,830€+01 
3, 185E+01 
5S. 695E+01 
1.ON1E+02 
1, 99ME+02 
3.043802 
6. 33902 


21 


6.719€-01 
7.068 -01 
7.S17E-O1 


1.401E+00 
1, 782E+00 
2.418€+00 
3. 528E +00 
5.S55E+00 
9. M07E+00 
1, 698E+01 
3. 20E+01 
6. 400E +01 
1, MRE Oz 
2. THE+02 
5. 833E+02 
1. 2606403 
2.732003 


1.0006 +00 
8. 181E-01 
7.96%-01 
8.287E-0) 
£.960-01 
1.0006 +00 
1.155E+00 
1.393400 
1. 770€+00 
2.4006+00 
3, 500E +00 
5.512400 
9. 3406900 
1.687E+01 
3.212640! 
6.396401 
1,3036+02 
2, 7306+02 
S.822E+02 
1, 2598403 
2.752603 


1, 2B7E*01 
2.614€01 
‘S.6S2E+01 
1.280602 
2. 999E902 
7. E02 
1, 762E+03 
4.372603 
1.O97E+O4 


1, 0006 +00 
8. 1626-01 
7, 938E-01 
8.262E-01 
8, 940€-01 
1. 000E +00, 
1, 161E*00 
1. ALME+00 
1.035E+00 
2.579E+00 
3. 984E+00 
4. BOE +O) 
1.277801 
2.597E+01 
5.619401 
1, 2746+02 
2. 987E+02 
7.180802 
1, T58E+03 
4. 3B7E03 
L.OF7E+O4 


1.7401 
4,005 +01 
9.STEO 
2, 500E02 
6,881E+02 
1,897E903 
‘5. 331E+03 
1.S19E+O4 
4. TE 


312 
1.0006 +00 
8, 153€-01 
7, 9266-01 
8. 2496-01 
8,929€-01 
1, 000€+00 
1, 165E+00 
1.42900 
1, 885E+00 
2.737E+00 
470 
8, 2KE +00 
1.73101 
3, 978€ 901 
9.814E+01 
2.547E+02 
6. 8SHEH02 
1,.8928+03 
5. 3216403 
1, S18E+04 
4. 3786904 


6.67E-O1 
7.021E-O1 
7.468E-01 
8.058E-01 
8. 860E-01 
1,000€+00 
1.171E#00 
1, 48E+00 
1, 938E+00 
2. 900E+00 
S.005E+00 
1.010E+01 
2, 350E+01 
O. 1148901 
1.722802 
5.120602 
1, 580E+03 
5.003E+03 
1.1SE+O4 
S.2BoE oo 
1, 749E905 


1024 


1.0006 +00 
8, 1488-01 
7, 9208-04 
8242-01 
B.924E-01 
1, 000€ +00 
1, 167E#00 
1, 440€+00 
1, 928E+00 
2.877E+O0 
4. 963E+00 
10026401 
2.32+01 
6.07302 
4.712802 
5.07502 
L703 
4. 988E03 
1. bLIESO 
5.20644 
1. 7A9ES05 


TN-316 


.667E-01 
7.0ME-O1 
T.461E-01 
8.051E-01 
.OS4E-01 
1.000E+00 
1,1 75E+00 
1, 470E+00 
2, 06SE+00 
3, BO3E+00 


1.000E+00 
6.1438-01 
7913-01 
8.235E-O1 
6.91 7E-O1 
1.000€ +00 
1. 170E+00 
1.461Es00 
2.030E+00 
3.B29E+00 


BL(Nr,au) 


1, 0006+00 
9.S27E-O1 
9.MSE-O1 
9.49E-O1 
9.696E-O1 
1,.0008+00 
1,.040E +00 
1, 0B8E +00, 
1. 147E+00 
1.217E*00 
1, 298E +00 
1.393E+00 
1. SO4E+00 
1.633840 


BIW. r mu! 


1.0008 +00 
9, B0E-01 
9, 7378-01 
9.7198-01 
9, 7996-01 
1.0008 +4 
1035800 
1, 0908 +0«) 
1, 168-06 
1,277 
1. AZEW 
1, 6296406 
1, 901+ 
2.26400 
2. 7SE+00 
2, 4006 +00 
4.MEMO 
5.439900 
7.012400 
9.132000 
1, 2006401 


for re 


9,062E-01 
8.831E-0) 
8. 948E-01 
9.3M1E-01 
1,0006+00 
1,096E+00 
1, 230800 
1.414€+00 
1, 671E+00 
2.026 +00 
2.S21€*00 
3.219600 
4.213400 
5.627E+00 
T.O%EOO 
1, 069E +01 
1. SO8E +O), 
2.ASHESOL 
3.1NE+OL 
4.9301 


for r= 2 


1, 000€ +00 
9. T96E-01 
9. 69E-01 
P.OHlE-O1 
9. 728€-01 
1, 0006+00 
1. 048E +00 
1, 126E +00 
1, 2466400 
1, A2SE+00 
1, 68RE +00 
2.07SE+00 
2.0MEHOO 
3. 48SE+00 
4, 733600 
6, 00E+00 
9. MOE 
1, 366E+01 
2.014€+01 
3.006€+01 
4.53%+0) 


1. 2B1E+00 
1. 526E+00 
1.689€+00 
2.435E +00 
3.272400 
ALSTSE+00 
6.639640 
9. TAH 
1,S35E+0) 
2.472 +01 
B.O97E+O1 
6. 366E+01 
1,053E+02 
1, 760802 


R 


1.0008+00 
9,774E-O1 
9.630E-01 
9.993E-O1 
9.69801 
1.0006 06+ 
1, 058E +00 
1, 158600. 
1.315400 
1, S686 +00 
1.971800 
2.015 +00 
3.08900 
5.3718+00 
8.2100 
1, 300E +01 
2.114401 
3.512E+0) 
5.9301 
1.017E*02 
1.700 %02 


9. 201E-01 


13196900 
1.b17E*00 
2.071E+00 
2, 863E+00 
4. 100E+00 
6, 3986 +00 
1. 035E+01 
1, TS0E+01 
3.06SE+0! 
S.S21E+01 
1.016E+02 
1. SOMECO2 
3.614402 
6.93302 


1, 000E+00 
% 7O1E-O1 
9. C07E-01 
9 S65E-0) 
9, 6758-01 
1.000 +00) 
1. OodE+on 
11786400 
1.373640 
1, 2028+00 
2, 267E+00 
3, 256E+00 
S.025E+00 
8.262800 
1, 431E+01 
2, 5Q0E+01 
4. 8006401 
9.1M2E*O1 
1.773802 
3. 487E+02 
6.933602 


22: 


128 


1,000 +00 
8.924E-01 
8.607E-O1 
8.717E-01 
‘F.ITE-O1 
1,.0006+00 
1, 134E#90 
1, 346E+00 


1.269603 
2.752803 


178 


1.0006 +010 
9. TSE-O1 
9. 5956-01 
9, SS0E-011 
9. S61E-01 
10006 +00 
1.069E+00 
1. 198E 900 
1, 420E+06 
1 B24E+O) 
2.57% 
4.005€ +00 
6. B47E+00 
1. 267E+01 
2, 494E +0) 
5. 408401 
1, OF6E+02 
2, 395E+02 
3. 33dE +02 
1, 2056403 
2.752403 


11,0006 +00 
8, 911E-01 
8, 588E-01 


1. 366E*00 
1. 7S1E+00 
2, 440E+00 
3. 7S2E+00 
6. 4086900 
1, 205601 
2.4b3E+0! 
‘5. 36SE +01 
1, 2256902 
2,894E+02 
7.OME*O2 
1, 7316403 
4, EOF 
1.097E+04 


1,937E+01 
4. MATEO! 
1.0268 +02 
2.510002 
6. 2996+02 
1, 611€+03 
4.179803 
1. O9TE+O4 


‘312 


1.0006 +00 
9, THEOL 
9, SB6E-01 
9.S37E-O1 
9 ABE -O1 
1,000 +00 
1.074800 
1.215900 
1, AB7ESOO 
2.0316 +00 
3.198E 900, 
5.0B2E+0 
1, 207E*O1 
2.955401 
7. S76E 901 
2. 030€+02 
5.73802 
1.059642 
4.874003 
LASEK 
4, 7BE +04 


9. 1M0E-01 
1, 0006+00 
1. 144E+00 
1, 39E+00 
1, 832E+00 
2.714E900 
4.661600 
9.402800 
2. 197E+0) 
5. TSME+O) 
1.634E+02 
4, OF8EO? 
1.524€+03 
4.8706 +03 
1, SB6E +04 
5. 23BE +04 
1. 7A9E905 


1024 


1. 000E +04) 
9, T49E-03 
9, SBAE-01 
9, SME-O1 
9. 4bE-01 
1.000600 
1.0TSE*O0 
L.221E 0 
1.509600 
DAITE+OO 
BSI HOO 
TAZ OO 
1.670801 
A ASEOL 
1.320602 
4.0986 +02 
|. 321E+03 
}. S74E +03 
1, ATAE 04 
S.05% +04 
1, 749805 


TN-317 


8. 69-01 
B.674E-0) 
9. 1ME-01 
1, 0006 +00 
1 ATEHOH 
1, 408E +00 
1, 9ABE +00 
3.99% +00 


BUNrjmul for r= 4 


1,000E+00 1,.000E+00  1,000E*00 1, 000E+00 1. 000E+00 
9.9THE-01 9.957E-01  9.946E-01 9. 9M0E-01 9. 9348-01 
9.952E-01 9.918E-O1 9. 876E-01 9. BBHE-01 9. B74E-O1 
9.941E-01 9,B98E-01 9,869E-01 9. 851E-01 9. BAE-01 9.829E-01 9.829E-01 9. 628E-O1 
9952-01 9,916E-01 9, S90E-01 9, 87HE-01 9, B42E-01 9.B51E-01 9.850E-01 9, BASE-O1 
1.000E+00  1,000E+00 1.000E+00 1.000E+00  1.000E+00 1.000E+00 1.000E*00 1.000100 1.000E+00 1. 000E +00 
1,010€+00 1.019E*00  1.026E+00 1. 031E+00 1.035400 1.037E+00 1.039E+00  1.080E+001.041E+00  1.042E+00 
1,027E+00 1.053100 1.075E+00 «1.093E+00 1. 107E+00 1. 1I7E*0O1.124E+001.129E+00 1.132800 1. 140E #00 
1,054E+00 1.109001, 160E+00 1. 05E+00 1. 243E+00 1.274800 1. 2998400 1.318E+00 1. 353E+00 1.38200 
1,0926+00 1, 194E+00 1, 278E*00 1, 399800 1. AIME*00 1.SB0EH00 1, 6SBE*O0 «1. 727EHO0 1. 7BBEHO0 2, 2048 +00 
1,144E+00  1,318E*00 1, 514E*00 1. 726E+00 1. 949E+00 2.179800 2.414600 2.651E+00 2. 890E HO 
1.2146+00  1,495E*00  1.848E+00  2.275E+00 2. 7ESEH00-3.3TTEHIO 4.067E+00  4.B65E+00 S. 7HEHOO 
1,303E+00 1, 742E+00 2. 3SGEH00 3, 196E400 4, 32KE+00 5. BGMEHO0 7. B37EH00 1. 049EHOL «1.3998 +01 
1,415E*00  2,082E+00  3.1296+00 4, 748E+00 7.229600 1. JOLE*O] 1, 676E+01  2,SSOE*O] © 3. 87SErO! 
1, 555E+00  2,548E+00 4, 30384007. 3BSE*O0)1.278E+O1 «2. 2198401 3.B80E+O1 «4. 718E*O! = 1. 1708402 
1.727600 3, 182E+0G  G.0P1E*00 1. IDIE*OL §=— 2. SSSE*OL «4, OB2EHO1 «9. 3HEHOI «= 1.BASEHO2 = 3. P2KE 2 
1.938E+00  4,08SE+00 8, 826E+00 1, 974E*O1 4, 472E+0) 1, 02002 2.334802 5S. IKE «1. 2278203 
2.194E+00 5.219600 1, 303E+0] 9. IM0E*O1 «8. 6BHE*OL © 2. 27SEH02 §«S.9BIEH02 «1. STSE*O2 4, 154E #03 
2.S04E100 6. B19E+00 1, 52EH01 SL 7ASE*O1 = 1. 7ISE*O2  S.1HOE+02 = 1.SSBE*O3 4, 714E+03 1. A2BEHO4 
2.879 +00 9, 006E+00 2, 9800] 1.00002 3.43102 1.1GKE*O3 4.112803 1. 429EHO4 4, 972EHO 
3. BHO — 1. DOODLE 4, S33EO] 1, TOOT. 9SKE02 2, TSZECO3 «1, OPTE*OA 4 37RE SOS 1. 749405. 


9.869E-01 


Brau) for re 8 


mime 8 16 R “ 126 me 


1.000E+90 — 1,000E+) 1.000800 1,000E+00 1, 000E +00 1.000E+00 1.000E+ 1. 000E+00 1. 000E+00 1, OD0E HO 
S.99HE-01 9, 9BBE-O1 9, 9BSE-01 9. 9BIE-O1 9. PBZE-0L 9. 9BIE-01 9. 9BIE-O1 9. 9BIE-01 «9. 9BIE-01 9. 9BIE-01 
F.9BME-OL 9.973601 9. 96KE-01 9. F42E-OL 9, POOE“01 7. 9SKE~O] 9. 9S8E-O1 «9. 9STE*01 9. 957E*D1 © 9. ISTE-O1 
©, 978E-01 9, 961E-01 9, 9S0E-01 9, 9AKE~01 9, 940E-01 9. 997E-01 9.996E-01 —9.936E-01 9. 95E~01 9, SISE-01 
9.°HNE-O1 9, 963E-D) 9.95 2E-01 9. ONSE-O1 9. 940E-01 9. 998E-01 —9.936E-01 9. 935E-0) 9. 9SSE-01 9. 994E-01 
J.000E+H 1, 000E+00 —1.000E+00 1. 000E +00 1.000E HO §— 1. 000E+00 1. 000E+00 1. 000E+0 = L.000EHD0 1. OOUE HX) 
1.0040 LLOLIE*O0 = 1.014E900  1.O17E*00 1.020800 =F. O21E*00 1.022800 1.022000 1.023E+00 1.023600 
L.CITE*H) = 1.03300 1. 087E+00 1.058400 1.067E+00 § 1.073E+00 1.076E+00  1.0BIE*00 §«1.083E+00 1. 0B8E+00 
1.037E*O0  L.OTSE*O) 1.11000 1.142900 1, 168E 900 1. 1BFE*OD 1. 207E+00 1.220001. 231E #001. DOE HOO 
1.06900 1.14500 1.223400 1. EOD 1. ITIE*O0 1. A3OE*00 1, AMEOD 1. SABE) 1. 592E*00 1. USES 
1.116E*00 1, 255E*00 14136900 1, SBHE+0O 1, 763E+00 1. 949E+00 21378400 2.327800 2, S20EO0 
L.IBIE+W — 1,420E+00 1.720400 2.0B3EW00 2. 514E#00  S.01NEH 3. O0KEHOD 4. 2BMERIO 5. 06HE +00 
1, 268E*00 1, OSTE*00 2. 202E+00 2, 946E+00  S.99EC0N 5. 2BKECO) 7.0628 +00 1. B20 
1, 3O0E+00 1, 9P1E#00 2.95000 4.433900 6. 706E*00LOL7E*O] «1. SMMEHOL «2. MSEWOL «3, SEO) 
L.S21E*00 7, 4S3E*O0 4, 1OLE*OO 6, 97GES00 1, 206E901  2,0P0EH01 S. OREO «6 SITE! 1. OPFE*O2 
1.696900 3. 067E+00 S.670E+00 1. 143E*O1 «= 2. 257E*O1 «4, 4B9E+0] |. 93SE*O1 «1. 7BMEWO2 © 3. STEHT 
1.910600 3,953E+00  G,590E+00 1. FITE*OL «4, MIESO} 9. BPGEH0] © 2. 265E 02S. 19SE*OZ «1. 1928403 
2.170600 S$. 135E+00 1.27901 «9, 270E 901 «8. SISE*O) = 2. 230E+02 5. B62E+02 «1.S44E*03 4, 0718403 
2, 4GE-00 6, TSIE*OO «1. OREO] S.O7BE+O1 «= 1.69SE*02 §S.099E*02 1, SHOEWO3 4, 6SBEW 1. AI IE SOE 
2,870E+00 8. 963E+00  2.94SE*01 9.9SIE*OL «3.4102 1.179E+03 «4. 0R0EHO3 1. AZIEROM 4, ASEH 
2.33% 1, 2O0E+01 4, S33EHO1 1. 7O0E0Z 6.933802 2. 7S2E+03 «1.OPTEHOA 4. 37BEHO4 1, 7498005 


23 


TN-318 


t 
: 


B1(K,r mu) 


1.0008 +00 
9. 9F8E-01 
9. 9958-01 
9.9E-O1 
9. PNE-O1 
1.000600 
1.003400 
1.011E+00 
1,.026€+00 
1.0546 +00 
1. OP7E+00 
1. 160E+00 
1. 2A7E*00 
1, 380E+00 
1, S04E+00 
1,681E+00 
1, 898E+00 
2.161900 
2. ABE $00 
2.B6E+00 
3. 333E+00 


1.000600 
9. 997-01 
9. 9918-01 
9. 9BR-O} 
9. FRAE-O1 
1.0006 +00 
1.0066 +00 
1.021E+00 
1.083400 
1.113400 
12146400 
1.372690 
1. 608E+00 
1, 939E+00 
2.408500 
3.0636+00 
3.914E900 
5.104E+00 
6. 7Z7ERO 

. SAE HO 
1, 2008901 


1.000606 
9, 9996-01 
9, 9986-01 
9.997E~G1 
9, FOE-O1 
1,0006+00 
1, 002E- 
1.00780 
1.019%+00 
1.043€+00 
1, 083 *00 
1, 146E+00 
1.2538+00 
1. 348E 600 
1, A96E=60 
1,674E+00 
L870 
2, 158E+00 
2.478€+00 
2R5E+00 
2. 2GE-00 


8 
1.0008 +00 
$. 9998-01 
9, O97E-01 
9, 9945-02 
9, 9936-01 
1.0006 +00 
1,003E+00 
1. OLE +O 
1.039640 
1. 0R0E+i0 
1 184E owe 
1, 338E+00 
15726900 
1, 908E +00 
2. 378E+00 
3,021E+00 
3. B9RE #00 
S.0P1E+0 
6.719600 
8. 945E +00 
1, 200E+01 


fr r= tb 


te 


1,006 +00 
9. I9E~Ot 
9. 987E-01 
9. 9B1E-01 
99TH 
1.0006+00 
1.0086 +00 
1.030€+00 
1, 078E+00 
1. ATHErOO 
1. Wee +O0 
1.637E+00 
2, 1086 *00 
2.848E+00 
3.997600 
5. 768E #00 
B.AVLESOO 
1, 2708 +01 
197K 
2. 9806401 
4.533401 


fr re R 


6 


1. 000€ +00 
9.999601 
9. 990E-01 
9.993E-01 
9.ONE-O1 
1.000 «00 
1, 005€ +00 
1.019800 
1.057800 
1.139900 
1. TE 
1, S79E+00 
2.0808 +00 
2, 787E+00 
3, 940E +00 
5.718800 
8, MABE 00 
1.268801 
1.920601 
2.938E-O1 
4.S33E01 


R 


1.0006+00 
9.99SE-0) 
9. 987E-0) 
9.9796-01 
9.978E-01 
1,006 +00 
1,010€+00 
1.037E+00 
1, 101E+00 
1, 733€+00 


1. 120E 901 
1, BS4E+01 
3. 251E+01 
S.ASAEeO1 
9. FAE*OL 
1, 7OOEHO2 


1, 1MME+O1 
1.883640) 
3.242401 
S.O46E+01 
9,921 
1, 7608902 


ry 


1,.000€ +00 
9. 99SE-01 
‘9. 987E-0) 
9.977E-01 
9.974E-01 
1.0006 +00 
1.011E+00 
1, 043E+00 
11196400 
1.289600 
1.639E+00 
2. 340E+00 
3,7176+00 
6. 409E +00 
11896401 
2.201690) 
4, 7856401 
B.ASE+01 
1, 688E +02 
3. 4066 +02 
6. 9336002 


4. 261E+01 
8. 425E +01 
1.685402 
3. 405E+02 
6. 93302 


128 


1.0008 +00 
9.9FE-O1 
9. 9986-01 
9.976E-01 
9.97E-01 
41,0006 +00 
1,0126+00 
1.087E+00 
1, 13E+00 
1.339600 
1.7948 +00 
2. 787E+00 
4, 9506 +00 
9. 696E+00 
2.02%r01 
4, 389E+01 
9. TOOL 
2.213402 
5.077E+02 
A.L77E+O3. 
2.752003 


126 


1.0006 +00 
9, 98-01 
9, 9998-01 
9, 916-01 
9, 9RE-O1 
1.0006+00 
1.0076 +00 
1.0306 +06 
1.0986 +00 
1.2716+00 
1.08100 
2. 625€+00 
4. 725E +00 
9. MORE +O) 
1, 9BRErO 
4.304801 
9. TIME 
2, 2086402 


1,.0006+00 
9. 9FE-O1 
9, 9B6E-0} 
9.978E-01 
9.97%E-01 
1,000€ +00 
1.012£+00 
1.0506 +00 
1, 1A7E+00 
1, 385E+00 
1, 952E+00 
3. 207E+00 
6. S87E+00 
1.4901 
3.51201 
TATED! 


1, OTE*OO 
1.819900 
2.097EW0 
6.275+00 
1, 428EO1 
3, AA7E+01 
8.6588 +01 
2.2%? 
$.799E 02 
1,$31£+03 
4.083603 
1.087E+08 


Siz 


1.0006 +00 
9. FEO 
9, 966E-01 
9.976E-01 
9.972E-01 
1.0008 +00 
1,0136+00 
1.0526 +00 
1, 1S7E+00. 
1 A25E+00 
2.112600 
3. 907E+00 
8, TSAE+00 
2.228601 
6, 1068 +0} 
1.746602 
5. 127E+02 
1.932903 
4, 6396403 
1. A190 
4, TBE + 


S12 


1.000600 
9, 998E-01 
9, OSE-01 
9, 9F1E-O1 
9, PRED 
1.0008 #90) 
1.007496 
1.033400 
rsd 
1.339600 
1.9STESOO 
5. 043000 
8, 3206 +00 
2, 158€+01 
5. 9926401 
1.728602 
5, 097E+02 
1, 527E+03 
4. 632E+03 
1.418E+04 
4. 378E +04 


1.000€+00 
9, 995E-01 
9. 9R6E-01 
9.9TSE-01 
9.972-01 
1.0006 +00 
1.013400 
10836400 
1. 1e4E +00 
L.Ab1ES00 
2.27%+00 
A SPIEWO 
1, 1626401 
3,379E +01 
1, 0626402 
3,489? 
1.177903 
4.0396 +03 
1. AOSE +04 
ASEH 
1, 7696905, 


1024 


1, 0006 40%) 
9, 99BE-D) 
9, 9PSE-O1 
$. 9F1E-01 
9. BBE -O1 
1.0006 +00 
1, 007E+00 
1 034E+00 
1.1198 +00 


4,0276+03 
1.03408 
4. 7NE Oe 
1. 7496905, 


TN-319 


9.971E-01 
1.006400 
1.013406 
1.058E +90 
1. 1B8E+00 
1. 705400 


BIIN,r eu) 


1,.000E+00 
1.000E+00 
9.99FE-O1 
9. 999E-O1 
9. 998E-O1 
1,000E+00 
1,001E+00 
1, 005E+00 
1.014400 
1, 035E+00 
1,073€+00 
1, 15E+00 
1, 224E+00 
1. SEO 
1, 489E+00 
1,670€+00 
1, 890E +00, 
2. 150E+00. 
2.47700 
2.865E900 
3. 33E+00 


1,000E+00 
1.000E+00 
9. 9FE-01 
9. 998E-01 
9.99TE-01 
1,000€+00 
1,002+00 
1,009E+00 
1,.0286+00 
1,0736+00 
1, 161E+00 
1.353400 
1, SABE+00 
1, 889E+00 
2.3636 +00 
3.010E+00 
‘3.B91E+00 
5.087E+00 
6. 716E+00 
8. 943E+00 
1, 200E+01 


BLN, ru) 


for r= 


for r= 64 


ity 


1,.000E+00 
1..000E+00 
‘9, 9PE-OL 
9.997E-O1 
9. 9ME-O1 

«000E +00 
1,003€+00 
1.013400 
1, 042E+00 
1.112800 
1, 261E+00 
1,536E+00 


1% 


R 


1,.000€+00 
1.000+00 
9, 9996-01 
9, 997E-O1 
9995-01 
1.000600 
1,003€+00 
1,0168+00 
1.0546+00 
1, 151E+00 
1,3696+00 
1, 8086 +00 
2.624640 
4.080640 
6.624600 
1, 105801 
1, 8796401 
3.738E+01 
S.OM4E+01 
9.927EHO} 
1, 760E+02 


1,.000€+00 
1.000E+00 
9. 999E-O1 
9. 997E-01 
9. 99E-01 
1.000€+00 
1, 004E +00 
1.018+00 
1.0646 +00 
1,.167E+00 
1, 482E+00 
2.1296+00 
3. 461E+00 
6. L19E+00 
1, 137E+01 
2. 177E+0} 
4. BiE01 


128 


1,000€+00 
1,.000E+00 
9. 99-01 
9. 99TE-O1 
9. 9FE-O1 
1,000E+00 
1,004E+00 
1.020€+00 
1.072800 
1. 2206400 
1.6006 +00 
2. 506E+00 
4.57 +00 
9.229800 
1, 966E+OE 
4.2L 
9.0REOL 
2.200802 
S.067E+02 
1, 176803 
2. 7S2E03 


128 


1, 00000 
1,000E+00 
9. 998E-01 
9. 997E-01 
9. 9FSE-O1 
1.000 +00 
1. 004E+00 
1,021E+00 
1.076€+00 
1. 249E+00 
1,7196+00 
2.944800 
6. 060E +00, 
1,.396E+01 
3.401E+01 
6.611E+01 
2, 2186902 
‘5. 793E*02 
1, 530E+03 
4, 080€+03 
1.097E+04 


‘312 


1.000E+00 
1.000E +00 
9. 9E-O1 
9. 990E-O1 
9, 9VE-O1 
1.000€+00 
1,.004E+00 
1.022E+00 
1,083E+00 
1, 273€+00 
1,.840E+00 
3.4S0E +00 
8.02% +00 
2AM 
‘5. 929E+01 
1, 7198+02 
‘5.085E+02 
4,526E+03 


1, 416E+04 
4. S7REE 


1,000€+00 
1, 0008 #00 
1,.000E+06) 
1.0008 #00 
9, 9996-01 
1, 0008 +06 
1, OLE 
1.003800 
1, 0108+00 
1.029840) 
1, 065E+00 
1.127Eo) 
1.21 7E +06 
1, 330E 900 
1, MEBE%00 
1, b6BE 900 
1, 629E 00, 
2.1SEMO 
OTE 
2.865E+00 
3. EO 


LODE +00 
1. EHO 
1, 294E+00 
1, 5326400 
1. B77E+00 
2, SS4E+00 
3.005840) 
3, 687E+00 
5.08SE +00 
6.755E+00 
8, 9836400 
1, 200601 


1.031800 
1,092E+00 
1. 232E+00 
1, SOME #00 
1, 9738+00 
2.72 
3.B91E+00 
5.6796+00 

| A21E +00 
1. 265E+01 
1.919E901 
2,.938E+01 
4.53001 


1, 0006 +00 
1, 0006 +00 
1.0008 +00 
9, 9FE-O1 
9, OPRE-O1 
1, 0006 +06 
1,002£ +00 
1.010800 
1.0406 +00 
1. 124E +00 
1, 3296+00 
1, 7S%Eo00 
2. 5716E +00 
4.037E00 
6, SBPEHOO 
1, 103E001 
1.877801 
3.237801 
‘5.430! 
9. 928E+01 
1, 7HOE +02 


1, 002E+00 
1.012800 
1, 047E+00 
1. 1536+00 
1, 430E+00 
2.0628 900 
3, 2BE+00 
6. 0ABE +00 
1 ARE +01 
217201 
4. 248+! 


1, 6B4E+02 
3. 40E +02 
6. 933E902 


25 


1,000€ +00 
1.00000 
1, 000E +00, 
9. 9998-01 
9, 99GE-O1 
1.0006 +00 
1.002800 
1,013€+00 
1.053900 
4. 181E+00 
1. SHME+00 
2.416E +00 

}. A71E +00 
9. 1ISE+O0 
5. 95SE+01 
|. 311401 
9. CBOE +01 
2, 2036+02 
5. 067E+02 

+ 176E+03 
2.7828003 


1, 000E +00, 
1,008 +00 
9. 999E-01 
9. 9996-01 
9. 9986-01 
1.000400 
1,002E+00 
1.014800 
1,088E+00 
1, R5E+00 
1.640800 
2.827E+00 
5. 909E+00 
1. 378E+01 
3. 391EO1 
8. S85E+01 
2.215802 
5. 790E+02 
1. SHES 
4.080€ +03 
1.097E+04 


1024 1 
1,000E+00 1. 000E+00 
1.000E+00 1. 000E+00 
9.SME-O1 9, 998E-O1 
9. 996E-01 9, 99KE-O1 
9.9FE-O1 9. 9FSE-O1 
1,000E+00 1. 000E+00 
1,004E+00 1.00400 
1.022E+00  1.024E+00 
1.067E+00 1, 100E#00 
1,298E+00 1, 456E*00 
1. 961E#00 
4.05300 
1.062001 
3.203801 
1.031E+02 
3, 43502 
1, 167E903 
4.022603 
1.0 
4. IRE 
1. 749E905 

1028 "~ 
1.000E+00 1. 000E+00 
1.000E+00 1. 0008 +00 
9.999E-01 9, 999E-01 
9.99%E-01 9. 9998-01 
9. 99E-01 9. 9PRE-OL 
1.000E+00 1. 000E +00 
1,002€+00  1.002E+00 
L.O1SE*00 1. 015E*00 
1.085E*00 1. 074E+00 
1,205E*00 1. 37SE*00 
1 BSE +00 
3.8S1E+00 
1.033E+01 
3. 160E+01 
1, 0258902 
3.426602 
1, 166E+02 
4.021E+03 
MEE 
4. 932E 
1, 7498905, 
TN-320 


BLN rau! 


1,000 +00 
1.0006+00 
1.000800 
1.000E+00 
1.000E +00, 
1.000E+00 
1. 000E+00 
1.002E+00 
1, 008E+00 
1.024E+00 
1. 059E*00 
1.121E+00 
1.242800 
1, 333800 
1, 44E*00 
1,688E*00 
1. 0B9E+00 
2.1S8E00 
2.A7TE*00 
2.86500 
3, Hew 


1,0006+00 
1,000€+00 
1,000€ +00 
1,000E+00 
9. 999-01 
1.0006 +00, 
1,001€+00 
1.004E+00, 
1,.016E+00 
1, 050€+00 
LAWEHO 
1, 2B0E +00 
1,$20E+00, 
1,B69E+00, 
2, SOE +00 
3.00300 
3.8B6E00 
S.0BME+00 
6. TISESOG 
8.943800 
1.206901 


BLN rymu) 


1.000 
1, 000860 
1,.0006+00 
1,008 +06 
1. 000 t6 
1.000E +10 
1.0OOESiH 
1.001800 
1.068805) 
LONE 
1. OBAE ou 
Le Lnebece 
1. 20°00 
1. 331E +00 
1 MBE oe) 
L.GeTEHt 
1.B9E+H) 
2.150800 
2ATIESO 
2. 8¢5E+00 
3, 33+ 


t 


1.008400 
1.0008 +09 
1.0008+00 
1, 0006+ 
1, 0006+U 
1.000E +1) 
1. COE) 
1.003%) 
1.012840 
1. 082E+0H 
A. LIBE sin 
1.268640 
AS12800 
1. Gedo) 
2. MIE 
3.001 +00 
B.C 
S.0G4E +00 
8. MEH 
8.96300) 
1.20401 


fr re 


for 


6 


1.000 +00 
1, 0006+00 
1, 000E +00 
1, 000E+00 
9. 9996-01 
1.000€ +00 
1.001E+00 
1,005E+00 
1.0238+00 
1,077E+00 
1, 210€+00 
1. 4796400 
1. S200 
2.7096+00 
3. 8B1E+00 
5.673E+00 
8. AEE HO 
1. 264E +0 
1.9196+01 
2.938691 
4,933€+0) 


6 


1. 006€+00 
1.0006 +0) 
1.0008 +0 
1. 000€ +00 
1.0006 209 
1.0006 +04) 
1.001Ee 


1, 264E+01 
1.919E*01 
2.99Er1 
4 SKE: 


me 


ee 512 


2 


1,000€+00 
1.000€+00 
1.000E +00, 
1.000E +00, 
9. 9998-01 
1, 000€+00 
1.001E+00 
1, 007E+00 
1,029€+00 
1, 103E+00 
1, 2E +00 
1, 7226400 
2. SA1E+00 
4.010€ +00 
6,570E +00 
1 1O1E*O! 
1.8768 +01 
3.2E+) 
S.042E+01 
9,920E+01 
1. 7O0E 907 


2 


1.0009 
1 0008+) 
1. O00E +06 
1,000€ +0, 
1.060400 
1, 00100 
1.001606 
1, 0088400 
1.026400 
1 OBbE + 
1.270840 
1.692860) 
2.516E+ 
3.992600 
6. SSBESK! 
1, 101E+01 
1.676€ #01 
2. ZMEO 
5.642601 
$, 92601 
1, 7606402 


a 


1, 000€ +00 
1,000E+00 
1, 000€+00 
1, 000€+00 
9, 9FFE-O1 
1,006 +00 
1,001E+00 
1, 008E +00 
1, 035E+00 
1, 127E#00 
1, 3BRE +00 
2,009 +00 
DEO 
6.00300 
1, 127E+01 
2.169E+01 
4, 2448901 
4108401 
1, 084E+02 
3.602 
6.32 


26 


1,000€+00 
1, 000€+00 
1, 0006+00 
1,000 +00 
9.997E-O1 
1, 000€+00 
1.0016 *00 
1, 006€ +00 
1,0396+00 
1, 150E+00 
1.4800 
2, MeEHOO 
4. EHO 
9.082800 
1, 948E+01 
4 WEA 
4.67501 
2.202802 
S.066E+02 
1,176€*03 
2. 732E+03 


128 


1.0008 2) 
1, 6B 0) 
LOWE +0 
1. 000€ +00 
1.0006 #00, 
1. 0006+00 
1.001600 
1,068 #00 
1.030600 
1.125800 
1, 438E +00 
2, 20080) 
4, 238600 
8, 99ME +N 
1.945890), 
4, D301 
907K +0) 
2.202602 
5.0686 +02 
1.170890? 
2. 732£90? 


1, 000E +00 
1.000E +00 
1,.000€+00 
1, 000€+00 
9. 999E-O1 
1, 0006400 
1, 005E #00 
1, 007E+00 
1, 043E+00 
1. 1706+00 
1, ST77E*00 
2.737800 
5. 800E+00 
1, 3668901 
3, OE+O1 
8. S78E+O1 
2.210802 
5. 789E+02 
1,530E+03 
4, 0808 +03 
1, O97E+Oe 


Bm 


1. 0006 ix! 
1, 0008 +00 
1.0006 +00 
1.0006 +00 
1, 0006 
1, 0006+ 
1. OOLE rt 
1.Ode€ +00 
1.0326+00 
11426200 
15208460) 
2. 66840) 
5.721E+00 
1, 3596401 


‘312 


1.000 +00 
1.0006 +00 
1,000€+00 
9. 999E-01 
9. 9VE-O1 
1,000€ +00 
1, 001E+00 
1, 0097E+00 
1, 0465 +00 
1, 1BBE +00 
1,874€900 
3.189800, 
7.662*00 
2.068801 
S.873E+01 
1, 7128902 
S.077E+02 
1,5258+03 
4. 6296603 
1,418 +04 
4, STBE + 


1, 000€ +00) 
1 000E +00 
1. OME +O) 
1, 0006 #00 
1, 000€ +00) 
1, 0008400 
1. QO1E*O0 
1, 000E+00, 
1.0E 00 
1 1STESCO 
1. O1ME HOG 
3. 07BE +00 
T.SS3E+00 
2.05E+ 
S.6eEeb) 
1. 7118422 


4. S7PE+O8 


1,000€+00 
1,000 +00 
1, 000€ +00 
9. 999E-O1 
9. 9PFE-O1 
1,006 +00 
1, 0018 +00 
1.010840 
1, 0486 +00 
1, 2048 +00 
1.772900 
3.710E+00, 
10128401 
3.13201 
1,0228+02 
BADE? 
1.185802 
4.020690 
1,402 +04 
ALTIE4 
1, 749905, 


1024 


1, 0006 +00 
1 000K +0 
1, 0006 +00) 
1.000900 
1 0000 
1, C0000 
1, 001409 
1.00bE +1 
1. O36E+00 
1.170206 
1.703840 
5, 5BE+00 
GOTH 
BME 
10206902 


1, 7496408, 


a 
1, 000E +00 
1.000€+00 
1,000E+00 
9. 99-01 
9. 9996-01 
1,000€ +00 
1,0018+00 
1.0108+00 
1,055E+00 
1.311€900 


1.000648 
1, 000E +06 
1. 0006406 
1,.0006*90 
1, 0008+ 
1.0004» 
1, 0O1E+0C+ 
1.067E*OU 
1.012600 
1, 2618600 


TN-321 


BLN rau 


fore 


1024 


16 


a 


‘312 


1, 000€+00 
1,000E+00, 
1,000€+00 
1,000E+00 
1.000E+00, 
1.0006 +00 
1, 0006+00 
1.001E+00 
1,004E+00 
1.017600 
1, O49E+00, 
1.112600 
1. 206E +00, 
1, 330E+00 
& 1,482E+00 
$1, 667E#00 
+ 1, 8B9E+00 
+ 2, 156E+00 
+ 2ATTE*O 
t  2.ReSEen0. 
+ 3.303 


B1IN,r pub 


1. 00NE +00 
1.0006 +00 
1.0006 +00 
1.0006 +00, 
1. 0006+00 
1. 000€ +00 
1.006600 
1.Q01E+00 
1,003E +00 
4.0148 900 
1. O45E+00 
1. LORE +00 
+ 1. 206E+00 
13298400 
2 1.Me2E+O0 
2 L.667E*00 
2 2 1,889E+00 
4 2.1SHEHOO 
4 2  2.47TEHOO 
Bt 2.8eSEetd 
2 3.22%ed) 


1,000E+00 
1.000E+00 
1,.000€+00 
1.000E+00 
1,.000€+00 
1.0006 +00 
1.0006+00 
1,002E+00 
1, 0096400 
1,035E+00 
1, 108E+00 
1. 259E+00 
1, SO5E+00 
1,.B60E+00 
2. MSEHO0 
3.001E+00 
3. BBSE*00. 
5. 084E +00 
6. 714E+00 


1, 2008401 


8 


1, 000E +00 
1..000€ +00 
1, 000E +00, 
1.0006 #00 
1, 0008 +00 
1.000E +1 
1.0008 +00, 
1. O01E+00 
1. 007E +00 
1.03000 
1, 1006 +00 
1.251600 
1, 01E+00 
1, 858E +00 
2, USE 
3. 000E +00, 
3.885 +00 
'5.0B4E +00 
6. 714E900 


for r= 


1,000E +00 
1.000€+00 
1,.000€+00 
1.000E+00 
1.000E+00 
1.0006 +00 
1,000E+00 
1,002E+00 
1,013E+00 
1.054E+00 
1.17500 
1.44E00 
1, 924E +00 
2.693800 
3.8700 
5.668E+00 
8. 416E 00 
1. 204E 901 
LIES 
2.9REOL 
4,53%+0! 


16 


1, 0006-00 
1,000 +00 
1, 000E+00 
1.0008 +00 
1.000800 
1, 0008 +00 
1.0006 +00 
1,002E+00, 
1,010E+00, 
1.0468 +00 
1, 1626400 
1,431E+00 
1, 926E+00 
2, 688E +00 
3, B70E+00 
S.667EO0 
8. A1SE+00, 
1, 26ME +0} 
1. 949E+01 
2, 938E+0) 
4.93301 


2088 


1, 1006401 
1,676E+01 
3. 20E01 
5. b42E+01 
9. 926E+O) 
1, 700E +02 


2 


1,000€+00 
1.0006 +06 
1. 000€+00 
1,000 +00 
1, 0006-+00 
1.0006 +00 
1.0006 +00 
1, 0026+00 
10126400 
1.0616 +00 
1. Z29E+00 
1. 648600 
2.48900 
3.972E+00 
6, SABE+00 
1, 100€+01 
1.875401 
3. 736E+01 
5.042E+01 
9.926E+01 
1, 7606402 


1,.000E+00 
1.000E+00 
1,000E +00 
1, 000E+00 
1.0006 +00 
1,.000+00 
1.000E+00, 
1,.003E+00 
1.0206+00 
1,090E+00 
1, 32400 
1, 934E+00 
3. 268E+00 
5. 953E900 
1.124401 
2. 167E+01 
4, E401 
B.409E+01 
1.6846 +02 
3, 404E+02 
6. 93302 


1.0006 +00 
1.000640) 
1, 0006 +00 
1, 0006 +00 
1.0006 +00 
1. 000E +00) 
1, 0006 +00 
1, 002E+00 
1,015E+00 
1, 076E +00 
1, 2996+00 
1, 906E+00 
3, 207E+00 
S.941E+00 
11238401 
2. 167E+01 
4.3001 
8. 40%E+0) 
1, OBME+02 
3, 404E+02 
6.9336+02 


4, 1768403 
2. E02 


1,.000€+00 
1, 0006 +00 
1.000E +00 
1.000€ +00 
1, 000€+00 
1.000€ +00 
1.0006 +00 
1.0026+00 
1,017E+00 
1,089€+00 
1.3700 
2. 09E +00 
4, 2688 +00 
8. 942E+00 
1, $41E+O1 
4. DE+O1 
9.67E +01 
2.202902 
5.068E+02 
1.1 76E+03 
2.73003 


27 


1. 000€+00. 
1,.000E+00 
1.000E+00 
1,000€+00 
1.000E+00 
1,.000E+00 
1,000€+00 
1, 004€+00 
1.028E+00 
1, 120€+00 
1, 483E+00 
2. 007E*O0 
5.663€+00 
1, SAE9O1 
DWE 
8. S69EHO1 
2.213802 
5.798002 
1, S30E+03 
4. 080E+03 
1,097E+04 


ro) 


1, 000E+00 
1, 0008 +00 
1,000E +00 
1,000€ +00 
1, 000E+00 
1.000E +00 
1.0008 +00 
1.003€+00 
1.018E+00 
1.101€*00 
1.4466 +00 
2. S00E+00 
'S.6206+00 
1, 31EO1 
3. 67EO1 
8. S68E+01 
2.2102 
5. 789E+02 
1, 5HE+03 
4, 080E +03 
1.097E+04 


1,000€+00 
1.000€+00 
1,.000E+00 
1.000€+00. 
1,000E+00 
1.000E+00 
1,000E +00 
1,004E +00, 
1,026E+00 
1,.132E+00 
1, Se4E+00 
3.0255 +00 
7.47200 
2. 049E 901 
S.855E+01 
1.711E+02 
S.075E+02 
1.525803 
4. 6286003 
1.4186 +08 
4,78 +08 


S12 


1, 000€+00 
1, 0006 +00 
1, 000E+00 
1.0006 +00 
1,.0006+00 
1.0006 +00 
1.0006 +00 
1,003E+00 
1.019€+00, 
1, 112E+00 
1,S21E+00 
2. 966E +00 
7.41200 
2,044E+O1 
‘S.OS1E+01 
1.710902 
5.07302 
1.5203 
4.678E003 
1A 1BE+O 
4 378E 


1028 
1,0006+00 1. 000E+00 
1.000€+00  1.000+00 
1,0006+00 1, 000E+00 
1.000€+00 1, 0006400 
1,0006+00 1.0006 +00 
1.0006+00 1.000600 
1.0006+00 1.006400 
1.0088+00  1.004E+00 
1.027E+00  1.031E+00 
1.144E+00 1.220400 
1.045800 
3. S07E+00 
9, 862E+00 
3.102501 
1.018402 
3.418602 
11655403 
4.020603 
1.402404 
49328908 
1. TASES 

1026 NF 
1,000E+00 1, 000E+00 
1.000E+00 1. 0006400 
1.000E+00 1, 000€ +00 
1.0006+00 1.006400 
1.000E+00 1. 0006400 
1.000E+00 1. 0006+00 
1.0006+00 1, 000€+00 
1.0036+00 1.00300 
1.020400 1,0736+00 
1.122800 1, 186E+00 
1, 5968+00 
3,43HE+00 
9, 7806+00 
3.071 
1. 0186402 
3.ALTEHO2 
1,165E+03 
0208903 
1, A02E+04 
4.9308 
1.749905 


TN-322 


BLIN,r mu) 


6 


for r= INFINITY 


2 


' 
' 


1,0006+00 
1.000E +00 
1, 0006+00 
1.000600 
1.0008 +06 
1,0006+00 
1. 000600 
1,0006+00 
1. 000E +00 
1.0008 +00 
1, 0008 +00 
1,OP1E+0 
1. 198E+00 
1.327800 
1, A62E+00 
1,667E+00 
1, 6B7E*00 
2. 156E*00 
2.477E+00 
2. 865€ +00 
3, R33E+00 


1.000640 
1,0006+00 
L.000E+X0 
1.0006 +00 
1.000800 
1.0006+00 
1.0008 +00 
1,000E+00 
1,000E+00 
1000+) 
1,0006+00 
1, 2106+00 
1 MBTEn 
1, 854E +00 
2, W%E+00 
3.0008 +00 
3.625E+00 
‘S.0B4E+00 
6, 7L4E+00 
8.9438+00 
1, 2008401 


1,0006+00 
1,0006+00 
1, 0006+00 
1, 0006+00 
1, 0006+00 
1,0006+00 
1,000E+00 
1.0006 +00 
1, 000E+00 
1,0006+00 
1,000€+00 
1, 260E +f! 
1.8B90E+00 
2.6808+00 
3.867E+00 
5.667E+00 
8.415400 
1, 2646401 
1.919640 
2.938600) 
4.933401 


1,.000€+00 
1, 000€+00 
1.0006 +00 
1.0006 +00 
1, 0006+00, 
1, 000€+00 
1.000€ +00, 
1.000€+00 
1. 000E +00 
1, 000E +00 
1,000€ +00. 
+. SH1E+00 
2.M41E+00 
3, 958E+00 
6.543400 
1, 100E+01 
1, 87301 
3.236601 
‘5.042800! 
9.928001 
1, 700E*92 


1, 0008+00 
1, 000€+00 
1, 000€+00 
1, 0006 +00 
1,000E +00, 
1, 000€+00 
1, 000€+00 
1.0008 +00 
1, 000E +00 
1, 000€+00 
1, 0008 rin 
1, TSTE+00 
3, 184E +00 
5.916800 
1.1201 
2.167601 
4 MEO 
8.409601 
1. 6B4E +02 
3. O0KE 902 
6. 953E+02 


28 


9.07HOL 
2.20202 
5.0866 +02 
1, 176E +03 
2.752903 


1, 710E*02 
‘S.07SE*02 
1.525603 
4, 6286402 
1. 418E+04 
4, 78E +04 


3, 0B0E +01 
1.087E+02 
3.41 7E002 
1, 1656403 
4, 020E +03 
1, AO2E+04 
4, 9326404 
1, 7496905, 


TN-323 


“he 


6.667E-01 
1,1128-01 
1,674E-02 
3,208 -03 
5. SBE-O4 
1, 000€-04 
1, 8628-05 
3.687E-06 
8. 121E-07 
2.159€-07 
7. 726E-08 
3. 906E-08 
2, SE -08 
2.013 -08 
1. 700E-08 
1. 500E-08 
1, 3S7E-08 
1,.265E-08 
1. 1S2E-08 
1072-08 
1,000€-08 


6.667E-01 
1, 3E-01 
2, 908E-02 
b.196E-03 
1, WSE-03 
3.000E-04 
6, 9S6E-05 
1.715805 
4, 6706-06 
1, S10E-06 
6..240€-07 
3.397E-07 
2.311E-07 
1, G08E-07 
1,S29€-07 
1. S0E-07 
1.221€-07 
1, 1206-07 
1,0376-07 
9.0ASE-08 
9, 000E-08 


3.0006 -03 
1, 101E-03 
4, PRE 
1. Q09E-04 
8, CO6E~0S 
4, 0SE-05 
3, 068E-05 
2. 22-05 
1, 788E-05, 
1, 524E-05 
1. 9E-05 
1. 221€-05 
112-05 
1,037E-05 
9. OASE-06 
9. 000E-06 


6, 667E-O1 
2.79E-O1 
1, 1836-01 
‘5.0B1E-~02 
2.22K-02 
1,000€-02 
4.06203 
2. 2886-03 
1.204€-03 
‘6. 921E-04 
4, MAE-04 
3, 100E-04 
2. BIE-04 
1 EO 
1, 683E-04 
147-4 
1, SE-04 
1.26E-O8 
1. 1S2E-04 
1.072-04 
1,000€-04 


29 


6, 667E-01 
3.479801 
1, BQME-O1 
9, 8286-02 
5. 362E-02 
3. 000€-02 
1.73E-02 
1,047E-02 
6. 6b4E-~03 
4. 507E-03 
3. 250E~03 
2, 494E-03 
2. 0206-03 
1. 708E-03 
1.493E-03 
1.337E-03 
1, 2168-03 
1,118-03 
1,036E-03 
9. A204 
9. 0006-04 


al 

(6. 667E-O1 
4.431E-01 
2.979%E-01 
2.032801 
1,410€-08 
1,000€-01 
7.2ME-02 
‘5.438802 
4 19E-02 
3. E-02 
2. 742E-02 
2,316E-02 
2,008E-02 
1.7702 
157-02 
1450-02 
1, 35-02 
1, 2338-02 


1.000€-02 


6.667E-01 
S.Se6E-01 
4 O7E-O1 
‘3.991 
3. 444E-01 
3.000E-01 
2.0A2E-01 
2.BIE-O1 
22-01 
1.1 
1. 7S0E-O1 
1,011E-01 
1.472E-O1 
1, 38E-O1 
1.207E-01 
1.21%-01 
1, 141E-OL 
1.074€-01 
1012-01 
9.SA1E-02 
9. 0008-02 


6,667E-01 
6. 2046-01 
‘5. 901E-01 
S.72-01 
S.27%-01 
‘5.000E-01 
4. 709E-O1 
4,S17E-01 
4. 0E-01 
4. 10%-01 
3.915E-O1 
3, 7406-01 
3574-01 
3. 4168-01 
‘2. 267E-01 
3.17E-01 
2. 989E-01 
2.859E-01 
2. 7HE-O1 
2.615E-O1 
2. S00E-01 


TN-324 


7 


6.667E-01 
6, 889E-O1 
7013-01 
7.061E-01 
7.52E-01 
7.000E-O1 
6. 916E-01 
6. 806E-01 
6. 0R3E-O1 
6, SAGE-O1 
6, M01E-01 
6. Z51E-O1 
6. 097E-O1 
‘5. 9436-01 
5. 789E-01 
S.63E-01 
5, 463E-01 
3.30801 
5, 1868-01 
5.0428-01 
4, 900E-08 


6.007E-01 
7.014E-O1 
7.4018-01 
6.051E-01 


1.42% 02 
3.63502 
1,052E+03 
2.928E+03 
8.215903 
2.317904 
6. SSME+O4 


1.01 


6.667E-01 
8.614E-01 
9 AZE-O1 
9. 716E-O1 
9.929E-O1 
1.0006+00 
1, 0046 +00 
1,008E+00 
1,007E+00 
1, 0096 +00 
1.010E+00 
1,011E+00 
1,012£+00 
1,013E+00 
1,014€+00 
1.015€+00 
1, 016E+00 
1.017E+00 
1,018€+00 
1.019€+00 
1,0206+00 


52 


6.667E-08 
7.014E-O1 
7.M61E-01 


2.621905 


6.067E-01 
7. EO 
8, 708-01 
9. 2B1E-01 
9.09HE-O1 
1. 000E+00 
1.024€+00 
1, 083€+00 
1.0608 +00 
1.075E+00 
1. 0B7E+00 
1, 1026400 
1.11400 
1, 126E+00 
1. 138E+00 
1. 1S0E+00 
1, 162E*00 
1.1 74E#00 
1. 1846400 
1. 198E+00 
1. 2106+00 


1024 


6. 067-01 
7.014€-01 
7.MB1E-01 
8.051E-01 
8.B54E-01 
1, 00E+00 
1.1 74E+00 
1. A63E+00 
2.00% +00 
3. 167E+00 
6. 0B2E+00 


4.050801 
1, 2B1E+02 
4, Mee? 
1, 536803 
5. SS8E+03 
2,039 +04 
7. SAVESO4 
2, B09E+05, 
1.049605 


6. 667E-01 
7.196E-O1 
7. 787E-O1 
8, MeE-O1 
9. 181E-01 
1.0006 +00 
1. OP1E900 
1, 192E+00 
1, 304E +00 
1, 429€+00 
1, S6sE+00 
1. 718E+00 
1, BBSE+00 
2.071E+00 
2.27500 
2. 500E +00 
2. 747E+00 
3.018*00 
3.216E+00 
3.04200, 
4.0006 +00 


OO7E~O1 
7.014E-01 
7. Mb1E-01 
8, 051E-01 
8. G54E-01 
1, 000E +00) 
1, 174900 
1, 465400 
2.0188) 
3. 7B 
6, 582E+00 
1.703801 
5.394600) 
1. MTE*O2 
7. STE 
3.072803 
1. 27TE+04 
5.38204 
72. 2886405 
9. 782E+05, 
AME HOG 


4. 6676-01 
7.062-O1 
7. Se1E-0t 
8.1928-01 
8. 9906-01 
1,000E +00 
1, 1786 +00 
1, 2906400 
1, 494E+00 
1, 75200 


6.64 7E-01 
7.014€-01 
7.461€-01 
8.051E-01 
6..854E-01 
1, 000Er00 
11748200 
1.ASTESOO 
2.0298+00 
3. ekoo0 
7.082E+0 
2.0086 +01 
7.167E*O1 
2. 9EN? 
1.319603 
6, 14403 
2.9K 
1, 4208905 
6. 937E+0S 
3. MORESO 
1,678E+07 


30 


6.467E-01 
7,0288-01 
TAME-O1 
8.103-01 
B.912E-O1 
1, 000E +00 
1, 1486400 
1, 351E+00 
1, 633400 
2.0276 +00 
2. 581E+00 


4.91301 
6. 400E +01 


16 


6. 667-01 
7.018€-01 
7472-01 
B.071E-O1 
6.879E-01 
1.000E+00 
1, 159E+00 
1. 3926400 


2, BOE) 
3. 7401 
6.008601 
9, 206E+01 
1, 574E02 
2, SMOES02 


R 


6.667E-O1 
7.015€-01 
7. MOSE-O1 
8. 058-01 
8.865E-O1 
1, 000E+00 
1. 1668400 
1, 4166 +00 
1,817&+00 
2.472000 
3. SB2E+00 
5.514€+00 
8.951E+00 
1, 5166401 
2. 6S3E+01 
4, THEO} 
8. GAME +O) 
1, S002 
2. 967E902 
5, ASE +02 
1.02403 


ry 


6.667601 
7.015E-01 
7.MZ-O1 
8.0501 
8,859E-01 
1,.000€+00 
1.170840 
1, 434E+00 
1,87E+00 
2.652800 
4.062400 
4.83 +00 
1.231901 
2, 48E+01 
4.669401 
9. SS0E+01 
1, P91E+02 
4.201602 
8.937802 
4.910€+03 
4.068403 


TN-325 
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6. 667E-O1 
7.014801 
7.462E-01 
8.052-01 
8, 856E~O1 
1.0008+00 
1,.1726+00 
1, 447E+00 
1, 973000 
2, BO9E +00 


B3(2,A,r,qu) for re .O1 


2.000E +00 
1,000E+00 2. 214€+00 
1,000E+00 2.4196 +00 


B.000E+00 1, 600E+01 3, 200E+01 4,400E+01 1,2B0E+02 2.560E+02 S.120E+02 1.028E+03 
1.829E+01 6.502840] 2.536E*02 1. 17HE+03 3. 30REW3 4.806E+03 6.080E+03 7. 145EH03 
2.638E+01 1,018E+02 4, 1SIE+O2 1.GB8E+03 S.O7SE+OS 7.272003 8.748E+03 9,082E+03 
1.000E+00  2,617E+00 B.29SE+01 1. 9O6E02 5, TSREHO2 2,542E+09 S.9O4EH0S 8.263E+UG 9. 700E*O9 1.063804 
1.0006+00 2. B11E+00 S.ONIECO] 1, 534E+02 6. 267E+02 2, S75EH03 6. 253EH0G B.UIEHS 9.671E+09 1.036808 
1.000E+00 3,000E+00 1, 100E+0] 4, 300E+01 1,710E+02 6.830E+02 2,674E+03 6.094E*03 €,047E*03 9.024603 9.512E+03 
1,000E+00 3, 180E+00 1,191E+01 4. 4S1E+O1 1.873602 7.06SE*02 2.SRE+O3 S.S7HE*GS 7.208E+03 7.950E+03 8.200E+03 
1,000E+00 3. 307E+00 1.258601 4, 0486401 1.G51E+02 6.877E+02 2. M2EHO3 4. 77SEC 6.04SEHOS 6.577E*03 6. 791E+03 
1,000E+00 3,444E+00 1,285E+O1 4,812E+01 1, 766E*02 6,21SE*02 1. 9STEPGS 3. 774E+09 4.686E+03 S.ONIE*OS 5. 17IE*03 
1,0008+00 3, 4636+00 1. 252E+01 4. 400E+01 1.S57E*O2 S.131E+02 1,486E*03 2.712E+03 3.304603 3.S21E+03 3.594E+03 
1,000E+00 3,368E+00 1, 1SIE+O1 3.866E+01 1, 253402 3.626E+O2 1.01SE*0S 1. 7SHEOS 2.097E+0S 2. 2108+03 2. 74E+03 
1,000E+00 3, 163E+00 9,992E+00 3.0R0EHO 9,213E+01 2.579E+02 6.25302 1,021E+03 1.200903 1.25903 1,277E03 
1,000E+00 2, 883E+00 6, 251E+00 2.314E+01 6. 2b6E+O] 1.S7SE*O2 3.SZIE+O2 5.442+02 6. 2B0E+02 6.49E+02 6.627E+02 
1,000E+00 2.574E+00 6,57SEH00 1.651E+01 4,018E+0! 9,228E+01 1.851E+02 2.70902 3.071E*02 3.18902 3.215E+02 
1.000E+00 2,270E*00 5, 1Z3E+00 11416401 2. 475E+01 9.2OOE+O) 1, 2BSE+02 1.431E+O2 1.476E*02 1, 488E+02 
1.000E+00 1,.989E+00 3,940E+00 7.728E+00 1. 486E+01 S.9OGE+O] 6. 444E*01 6.629901 6.673E+01 
1,000+00 1, 737E*00 3, 008E+00 S.177E+0O 8. 77SE+0O 1.435E+01 2.142E+01 2.6606+01 2.059E+O1 2.917E+01 2.933901 
1,000E+00 1. S14E*00 2, 2B9E+00 3, 446E+00 5.133E+00 7, 440E*00 1,005E+01 1.182800] 1.286601 1.267E*O1 1.272801 
1,000E+00 1, 319E+00 1, 736E+00 2, 2B5E+00 2. 985E+00 3.828E+00 4,678E+00 S.211E+00 5.405E+00 S.4S9E*O0 5. 473E+00 
L.000E*00 1, 149E+00 1, 3196+00 1.513640) 1.727E+00 1.960E+00 2, 166E+00 2,286E+00 2.328E+00 2.3M0E+00 2. 43E+00 
1, 000€*0" 1.00000 1,000E*00 1.000E+00 1,000E+00 1.000600 1.000E+00 1.000E*00 1.000690 1.000E+00 1.000E*00 


B12,M.reud for re 03 


a 312 


B.0Q0E+00 1, H00E+01 3, 20E+01 S.120E+02 1.024803 
1,6SE*O) 7. 19BE+O1 2.812802 4. 8B0E+02 6.53402 §.07SE*O2 9.O47E+O? 1.143003 
2, 70SE*O1 1. 119E*O2 4, 279E902 7. 19SE*02 9. 170E+02 1.08SE*03 1.180E*03 1.274603 
B.378E+OL 1.411E+02 5, 073802 1.298603 1. 263E+03 
B.910E+O1 1. QO7E*U2 5, 3BSE*O2 1.180603 1.212803 
4. 300E+O1 1. 7106902 $. 328E+02 1.07503 1.093903 
4.S2%Kevl 1, 7198402 4. 971902 9. TOE%02 9. 4S1E+02 
4. SAMEHOL 1.652802 4.376E+02 6.378E+02 7. 247E+02 7.000E+02 7. 700E+02 7. 79EO2 
HSNO 1.4SSE*02 3.618E +02 5. 126E°02 S$. 74K OZ S.97KE+02 O.057EO2 6.086E*0? 
D.BPHE+OL 1.2146+02 2. 797E*02 3.851E*02 4.26202 4, 405E+02 4.4522 4, 4088+? 
3. 200E+O1 9.46200] 2.019402 2.702902 2.9STE*O2 3.080E+02 3.0b8E*02? 3.070802 
2.039E+01 6. 912E+0] 1. 368E*02 1. 776E*02 1.924E02 1.970E+02 1. 9RHEO2 1. 987EO2 
2.002840) 4, 7746401 8. 737E*O1 1.108E+02 1, 184E+02 1.20902 1.2102 1.217802 
L.MO1E+O1 3, 1S3E+O] 5. MSE*O1 6.564801 6.97SE*OL 7.09501 7.128E+O1 7. 136E*01 
1.OSSE*OL 2.013E+01 3, 162E+01 3. 772E+01 3,97HE Ol 4.00001 4.085E+01 4.009801 
T.APIE*OO 1, Z5KE401 1. 82KE*OL 2.116690) 2. 210E+O) 2.23KE+O1 2.242E+01 2.24401 
4. 9OTE*OO 7, 0BBE+00 1.037E*O1 1.168E+01 1.209801 1.2Z20E+O1 1.27301 1, 224E+0! 
3.322E+00 4.6S8E+00 S.E29E+00 4.571E+00 6.S38E+00 6. SBTE*00 6.57SE+OO 6. 598E+00 
2.Z9ME*O0 2.Q01E+00 3. B1E+00 3.450E+00 3.S511E+00 3.52700 3,SG1E*00 3.532E+00 
1.497E+00 1.676E+00 1,B05E*00 1.860E*00 1.976E+00 1. 882E+00 1, 882E+00 
1,000E+00 1.000E+00 1,000E+00 1.000E+00 1. 000E+00 1.000E+00 1,.000+00 


31 
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oh 


83(2,",r,mu) 
2 


2. 000E+00 
2.2298+00 
2, 448E+00 
2.654800 
2.642E+00 
3.000E+00 
3.11 7E+OO 
3. 180E+00 
3.179800 
3. 111E+00 
2, 980E+00 
2. 799E+00 
2, SBME+OO 
2. 352E+00 
2, 116E+00 
1.888600 
1, 674E+00 
1, 477E*00 
1, 299% +00 
LEO 
1.0006 +00 


83(2.F. aul 


frre 


4, 000E+00 
6. 118E+00 
7. BObE+O0 
9. TE+OO 
1, 032E+01 
1, 100E+01 
1. 1Z7E9O1 
1, 11Es01 
1,01E+01 
9. TSTESOO 
8. 6E3E+00 
7, 902E+00 
6.31 7EO0 
‘5. 2088100 
4.221600 
3.377800 
2. 67HE+00 
2, 108E+00 
1, 647E+00 
1, 285E+00 
1, 000E+00 


4,006 +00 
5. 582E+00 
6, 903400 
6, 937E+00 
7, 013€000 
6. 833E+00 
6. ATTECOO 
6, 008E +00 
5. 478E +00 
4 ITE 
4.00 
3. 850E+00 
3,200 
2.919900 
2. SZ2E+00 
2.1 71E+00 
1, BME +00 
1.597E+00 
1, O7E+O0 
1, 109E+00 
1. 0006+00 


8, 000E+00 
2. 3278901 
3. 138E+O1 
3.626601 
3.053601 
2,883) 
3.694401 
3. SEO 
2.9B1E+01 
2. S28E+O1 
2.069840! 
1.042E901 
1, 2696401 
9. P1E+O0 
7 AZSE+O0 
5. 2%+00 
3. 7P1E+00 
2, 732E+00 
1, 980E +00 
1, MO1E+00 
1.0006 +00 


1, 600E+01 
4 MIE! 
6. 077EO1 
6. 919EO1 
TAKEO 
6. 906E +01 
6, BECO! 
‘S.617E+O1 
4, 7O0E+OL 
3.884801 
3. 059E+01 
2. SEO 
1, TREO) 
1.26201 
90136400 
6, SAE 00 
4 ASE+00 
3,074E +00 
2.1206+00 
1, ASTE+OO 
1, 000E+00 


16 


1, 600640) 
1, 3aE+O1 
1.2370! 
1 ATIE*01 
1, 1028+01 
1,021€+01 
9. OE +00 
8, 3398+00 
7.3748 +00 
6.443400 
5.5700 
4, 7B1E+00 
4.07400 
3.450600 
2. 9108+00 
2. MEO 
2.051800 
1, 716E+00 
14346400 
1.196400 
1.0006 +00 


2 


3, 200801 
‘S. 7S7E*OL 
7. IMMESOL 
8.621 
6. 911ECOL 
8, 4SE+O1 
7. ASEO1 
6.632801 
‘3.530! 
4 U7EOL 
3.4S5E*O 
2.0031 
1, 910E901 
1, 372Ee01 
9, CBSE +00 
6. 74SE +00 
4.683400 
3. 187E+00 
2.172600 
1, 475E+00 
11,0006 +00 


3, 20060) 
1, 980E +01 
1.521640) 
1. 17EOt 
1, 108E+01 
1.077E+01 
9, BBE +00 
8.010800 
7. Seek +00 
6.580E +00 
‘S.471E+00 
4, BiE+00 
4, 1738400 
3. AB6E+O0 
2.955E+00 
2, 463800 
2.062800 
1. 723E000 
1, 438600 
1. 2006+00 
1.006400 


32 


“ 


6, 001 
6.6716+01 
9, 267E+OL 
1,.005E+02 
9.90701 
9.2 
8.22201 
7.049E+01 
5.825601 
4 CATEOL 
3.58 7E+O1 
2.689601 
1. 964E+O1 
1, 805601 
9.678400 
4. 857E+0O 
4. 7148900 
3,218€+00 
2, 1B4E*00 
1, 4806 +00 
1, 0006 +00 


“ 


6, 40E 901 
2.987901 
1, BS4E+O1 
1, 40E*0) 
1. 242E+01 
1, 105E+01 
9, BSOE+00 
6.7100 
7.633800 
6. 624E 00 
‘5. 701E+00 
4.871800 
4,137 #00 
3, 49E+00 
2.942900 
2, 468E +00, 
2.065E+00 
1, 725500 
1, 439E+00 
1, 2006+00 
1,000E+00 


1, 2008902 
T.BQIE+OL 
1. 026E 902 
1, 0B4E902 
1, 0486 +02 
9.6101 
8, A7GESOL 
7.215601 
S.931ESO1 
4.714801 
3.6201 
2.714401 
1, 9796401 
14148901 
9.931800 
6.8846 +00 
4,700 
3.226600 
2. 189€+00 
1, 4B1E+00 
1, 0006+00 


128 


4, 2806402 
4. ATED 
2, 2858401 
1.SS7E+O) 
1, 278E+01 


2.50 +02 
8. 66SE+01 
1. 1OLE+O2 
1, 136802 
1 OBCE 902 
9, QOTErO! 
8. S91E+O1 
7, 2008+01 
‘5.96801 
4, THEO1 
D.OMlErOL 
2. TREO! 
1, 984E OL 
1.416E+O1 
9. 944E +00 
6. B94E +00 
4 THE +00 
3. 228E +00 
2.190800 
1, AB1E+00 
1, 000E +00 


1, 681E90) 
1, 305E+01 
1.126901 


4. 141E+00 
3. 498E+00, 
2, 94400 
2. 469900 
2.0668 +00 
1. 7266400 
1, 40 +00 
1.2008 +00 
1,.0006+00 


‘312 1024 


S.120E+02  1.0246+03 
9.7K) 1.0002 
1, 1S8E*02 1, 2018402 
1,170E*02 1.193802 
1,0P9E*02 1. 109E+02 
9, K+O1 9, 952901 
B.OMECO] 8. 662E+01 
7, SOSE+O1 7. 314E+01 
S.9B1E+01 5. 98SE+01 
4, TA2E+01 4.744801 
3,CASE+O1 3. AGE+O1 
2.7201 27246401 
1 9RSEO1 1. IBSEN 
A A17E*O1 1.4) 7E*O1 
9. 94BE+O0 9. 9A9E +00 
6. BPKE+00 6. B9GE+00 
4.7200 4. 735E+00 
3. 228E+00 3. 2296 +0 
2I91E+D 2. 191E+00 
1. 4BZE+0 1.482E+00 
1,000E+00  1.000€ +00 


S12 1024 


S,1208+02 1.028003 
1,20E02 2, 
3, 746801 
1.828801 
1, 328€+01 
1, 130E901 
9A 9. 900 
8. 756E+O0 8. 7bAE +00 
Ti GbAE OO 7. bb4E 00 
6.643E+00 6, 643E+00 
5.71200 5. 713E+00 


2.499400 3, 499E+00 
2.944E+00 2, 94ME+00 
2.469900 2, 469E+00 
2.0646+00 2, ObbE +00 
1.726E+00 1, 726600 
1, AA0E+00 1, 4406 +00 
1,200€+00 1, 2006 +00 
1,.000E+00 1, 000E +00 


TN-327 


$312,A,ru) 


1,.000E+00 
1,.000E+00 
1,.000E+00 
1,000€+00 
1,.000€+00, 
1, 000E+00 
1. 000€+00 
1,.000E+00 
1.000E+00 
1.000€+00 
1.0006+00 
1,.000€+00 
1.000E+00 
1,.000E+00 
1,.000E +00 
1.000E+00 
1. 000E +00 
1, 000€ +00 
1,000€+00, 
1.0006 +00 
41,0006 +00 


83(2,A,r ou) 


2 
2, 000E+00 
1, 3006100 
1. 105E +00 
1.0378 +00 
10116400 
1.0006 +00 
9. 46-01 
9, 938E-91 
9.9328-01 
9.931€-01 
9. 934€-01 
9. 9386-01 
9. 944€-O1 
9. 9508-01 
9. %566-O1 
9.962E-01 
9.970€-01 
9.978E-01 
9, 985E-01 
9.9926-1 
1.0008 +00 


for rs 


for rs 


4.0006 +00 
1, 77LE+00 
1. 234E+00 
1.073860 
1, 019€+00 
1. 000€ +00 
9.933E-01 
9.910E-01 
8, 905E-01 
9.907E-01 
9.901 
9. 920€-01 
9..928E-01 
9. 936E-01 
9. 90SE-01 
9. 9SME-O1 
9. 96%-01 
9.97%E-01 
9. 9B1E-O1 
‘9. 9E-O1 
1, 000€+00 


1 


8,.000€ +00 
2. ASE*OO 
1. 07E+00 
1, 110600 
1. 024E 900 
1, 000€ +00 
9.921601 
9. Q98E-01 
9895-01 
9. B99E-01 
9, GE-01 
9.914E-01 
9.9238-01 
9,.932E-01 
9.92E-01 
9. 952-01 
9961-01 
9. 971-01 
9. WBIE-O1 
9. 99E-01 
1. 000E +00, 


1,000E+00 
1,000E+00 
1,000E+00 
1,000E+00 
1,.000E+00 
1,.000E+00 
1, 000E +00, 
1, 000E +00 
1,000E+00 
1,000E+00 
11,0008 +00 
1.0008 +00 
1,.000E+00 
1,000E +00, 
1, 000E+00 
1,.000E+00 
1,.000E+00, 
1,0006+00 
1, 000E +00, 
1, 000E+00 
1, 0006 +00 


1.0006 +00 
9. 91%-01 
9.892E-01 
9.891E-01 
.996E-01 
OME 01 
913€-01 
9. 9228-01 
9.932E-01 
9. 9416-01 
9.9S1E-O1 
9, 9618-01 
9,9708-01 
9, 9808-01 
9. 9908-01 
1.0006 +00 


1, 000E+00 
1,000€+00 
1.00000 
1,.000E+00 
1.000E+00 
1.000E+00 
1,000E+00 
1,000E +00 
1,000E+00 
1,000E+00 
1.000E+00 
1, 000E+00 
1.000E+00 
1,.000€+00 
1,000E+00 
1,.000E+00 
1,000E+00 
1, 000E+00 
1, 000E+00 
1,000E+00 
1, 000€+00 


9.912E-O1 
9.9228-01 
9, 9316-01 
9, 9416-01 
9. 9S1E-O1 
9.961E-01 
. 9708-01 
9, 9808-01 
9.990-01 
1, 000 +00 


33 


1,000E+00 
1,000E+00 
1,000E+00 
1.000E+00 
1, 0008 +00 
1,.000E+00 
1,.000E+00 
1, 000E+00 
1,000E+00 
1,.000E+00 
1,000E+00 
1,000E+00 
1.000E+00 
1.000E+00 
1,.000€+00 
1, 000E+00 
1,.000E+00 
1,000E+00 
1,.000E+00 
1.000E+00 
1, 000E+00 


9.912801 
9, 9228-01 
9.931E-O1 
9.941E-O1 
9. FIE-O8 
9. 961E-01 
9.9708-O1 
9. 9808-01 
9. 9WE-O1 
1, 000€ +00 


1, 2808+02 
1, 669E+01 
3.32800 
1, 367E+00 
1, 054E+00 
1,.000€+00 
9, 902E-01 
9. 886E-01 
9, BOSE -O1 
9. 994E-01 
9, 903E-01 
9. 9126-08 
9. 9228-01 
9. 9RE-OL 
9. 9416-01 
9. 9S1E-O1 
9. 961E-O1 
9.970E-01 
9, FOOE-O1 
9. 990E-O1 
1.0008+00 


2.SROE+02 
2.636601 
4,5186+00 
1, 4848400 
1.08300 
1.000600 
9. 8998-01 
9.985E-01 
9.887E-01 
9. 8948-01 
9.90%-01 
9.9128-01 
9.92E-01 
9.9318-01 
9.94)6-01 
9. 9518-01 
9.9618-O1 
9. 9708-01 
9. 9806-01 
9. 9908-01 
1.000600 


1,0006+00 1. 
1.000E+00 1. 
1.000E+00 1 
1,000E+00 1. 
1.000E+00 1. 000E+00 
1.000E+00 1. 000E+00 
1,000E+00 1..000E+00 
1,000E*00 1.000E+00 
1,000E+00 1.000E+00 
1.000E+00 1.000E+00 
1,000E+00 1..000E+00 
1,000E+00 1,000E+00 
1.000E+00  1.000E+00 
1,000E+00 1,.000E+00 
1,000E+00 1.000E+00 
1,000E+00 1..000E+00 
1,000E+00 1.000E+00 
1.000E+00 1.000E+00 
1,000E+00  1,.0006+00 
1,000E+00 1..000E+00 
1,000E+00 1.000E+00 


312 


S.120E+02  1,024E+03 
4.67EO1 8. C01E*0) 
6. 324E+00 9. 057E*00 
1.037800 1.838600 
1,073E*00  1.064E+00 
1.000800 1,.000E*00 
9.G97E-O1 9. 890E-O1 
9.GB4E-01 9. 8B4E-O1 
9.887E-01 9.887E-01 
9.B94E-01 9. 0948-01 
9.9E-O1 9.90301 
99-01 9, 912E-01 
9.92H-01 9, 922-01 
9.931E-01 9. 931E-01 
9.941E-01 9. 941E-01 
9.9S1E-01 9. 9S1E-01 
9.961E-01 9. 961E-01 
9.970E-01 9. 970E-01 
9.980E-01 9. 9BOE-01 
9.990E-01 9. 990E-O1 
1.000E+00  1.000E+00 


TN-328 


83(2,R,r,eu) 


2 


2.000E+00 
1.494900 
1.2506 +00 
1,119€+00 
1.044E+00 
1,.000E +00 
‘9. 70-01 
9. S90E-01 
9. S10E-O1 
9. A7GE-O1 
9.47E-O1 
9, AME-O1 
9, S2%E-01 
9. S66E-01 
9. O17E-O1 
9.67401 
9. 735-08 
9. 798E-01 
$.B64E-01 
9.9NE-O1 
1,008 +00 


83(2.,r,0u) 


2 


2.000E+00, 
1, 690€+00 
1, 45E+00 
1, Z55E+00 
1, 1096400 
1.0006 +00 
9, 1986-01 
6.6328-01 
6.B%-01 
8.0286-01 
1, 922E-01 
792-01 
7.979E-01 
8. 1068-01 
8. B¥-01 
8. S00E-O1 
8. TS0E-O1 
9. 0298-01 
9. 331E-O1 
9.0S0E-O1 
1.000E +00, 


fore 
‘ 


4,000E+00 
2. 288E+00 
1.57300 
1.243E+00 
1.062£+00 
1.000€ +00 
9, SOAE-O1 
9. 3B0E-01 
9.21 
9. 270E-01 
9, BTE-O1 
9. 327E-O1 
9. BE-O1 
9.447E-O1 
9. S17E-O1 
9. 592-01 
9.670E-O1 
9. TSIE-O1 
$.832E-01 
9. 9108-01 
1nd 


fore 


4.0008 +00 
2.862E+00 
2.087800 
1, 568€+00 
1, 224E+00 
1.0006 +00 
5916-01 
7.7A8E-01 
7, 2ER-01 
7.080€-01 
7,0528-01 
7.18%-01 
7.316E-01 
7.SA7E-01 
7.8208-01 
8.125E-01 
8, AS4E-O1 
8.811E-01 
9. 186E-01 
9.582E-01 
1.0006 +00 


8..000E +00 
2.604400 
2.017E+00 
1,850 
1.117E+00 
1, 000€ +00 
9. ABAE-O1 
9. 268-01 
9.19E-O1 
9. 189E-O1 
9.22%E-01 
9.277E-O1 
9. W2E-O1 
9.415E-O1 
9.4901 
9.5728-01 
9.455E-01 
©, 7398-01 
9.625E-01 
9.91201 
1, 00089010 


2, 000E+00 
4.877E+00 
3.037E+00 
1, 904E 900, 
1, M7E+00 
1.0006+00 
8.1138-01 
7.1S1E-01 
6.727E-01 
6.614€-01 
6. 684E-01 
6, BO0E-01 
7,101E-01 
7, 3O4E-01 
7.096E-O1 
B.031E-01 
8. 3B6E-01 
8. 760E-01 
9. 1SHE-O1 
9, SesE-O1 
1.000E+00, 


1 


1. 4006401 
S.BISE+OO 
2.6S7E+OO 
1, SS6E+00 
1, 1S%+00 
1.000€+00 
9.4ME-O1 
9,202-01 
9. 16SE-O1 
9. 1S8E-O1 
9, 2006-01 
9. 2618-01 
9.3H1E-01 
9. 4OKE-O1 
9. 485E-01 
9.567E-01 
9.6S1E-01 
9.7HE-O1 
9.67E-01 
$. 1-01 
1.0006 +00 


1. 600€+01 
8.362600 
4 ASHE 
2.473800 
1, 4848 +00 
1.,000€+90 
7.7ZR-O1 
6.73E-O1 
6.394E-01 
4.377801 
6,57%-01 
6. 7SHE-O1 
7.031E-01 
7.2701 
7. 64E-O1 
8008-01 
8, 9-01 
8747-01 
914-01 
9.56201 
1.0006+00 


2 


3. 200E+01 
9. 700E+00 
3,.601E+00 
1.77200 
1.191E+00 
1.,000€+00 
9, W1E-O1 
9. 1608-01 
9119-01 
9.142E-01 
9192-1 
9, ZE~O1 
9. 327E-O1 
9, 40NE-O1 
9482-01 
9. S6bE-O1 
9.0S0E-01 
9. THE-O1 
9. 822-01 
9. PLIE-OF 
1, 000€ +00, 


3, 20E 1 
1. MEH 
6.56300 
3.137E+00 
1. 038E +00, 
1, 090E +00 
7. 99E-01 
6.4358-01 
6, 1088-01 
6. Zi1E-01 
6. 451-01 
6. 7138-01 


9. SO1E-O1 
1,000€ +00 


34 


6, 400801 
1.637801 
S.011E+00 
2.050800 
1, 7Z34E 900 
1.0006+00 
9,3E-O1 
9132-01 
9.105E-01 
9.13K-O1 
9.1001 
9. AE-O1 
9, 3288-01 


5 01 
9, 91E-O1 
1.0006 +00 


6. MO0E +91 
2.491E901 
9. THE 900 
4. 008E +00 
1,813%+00 
1, 000€+00 
7.11SE-O1 
6.21%-01 
6. 0578-01 
6. 18E-O1 
6.41 7E-O1 
6.097E-01 
7.000E-O1 
7.3198-01 


12 


1. 2908902 
2.79501 
7, 134E+00 
2.412800 
1.2800 
1.0006+00 
9. BE-O1 
9. AMIE-O1 
9. O0E-O1 
9. 131E-O1 
9. 1678-01 
9, 2AE-O1 
9, 320E-O1 
9.ME-01 
9.482 -O1 
9.56SE-O1 
9, 0A%E-O1 
9.75E-O1 
9822-01 
9. IIE-OL 
1, 000€ +00 


1728 
1, 2R0E +02 
4. 9E+01 
1, Ase +01 
5. 1S0E+00 
2.014€+00 
1, 0006 +00 
6.67E-01 
6. 087E-01 
5.97%-01 
6. 1M4E-01 
6. 401E-01 
6. 690E-01 
6. 997E-O1 
7.318€-01 
7.652E-01 
8. 000E-01 
8, 264-01 
8. 7448-01 
9. MEO 
9, SO0E-O1 
1, 000E +00 


2, SO0E +02 
4. B08E+O1 
1,034E +05 
2. 8BTEOO 
1,336E+00 
1.0006 +00 
9. BIE-O8 
9.OME-01 
9.070E-O1 
9, 1278-01 
9. 167E-01 
9, 253-01 
9.326E-01 
9, 2-01 
9.4BHE-01 
9. 6SE-01 
9, 649E-01 
9735-01 
9.872-01 
9. 9116-01 
1.0008 +00 


2, 50E02 
7.500601 
2, 203%+0! 
6, OSTE*OO 
2.2448 +00 
1.0006 +00 
6. Ob4E-01 
5. 9228-01 
‘S.917E-01 
6, 1238-01 
6. 9-01 
6, 687E-01 
6, 9966-01 
7. 3106-01 
7, 6S2E-01 
8.000E-01 
8. 20%-01 
8, 7448-01 
914-1 
9, 560-01 
1,.0006+00 


S.120E902 
8.311601 
1.519E901 
3.51200 
1, 398E+00 
1.0006 +00 
9. 22E-01 
9. 08-01 
9,067E-01 
9, 128-01 
9, 1666-01 
9. BR-01 
9, 3266-01 
9,M0K-O1 
9MBE-01 
9. S65E-01 
9, eC 

4, 358-01 
9.6228-01 
9.911E-01 
1..0006+00 


LUO 
8, OME+00 
2. 07E+00 
1,.000€ +00 
6.46%-01 
‘5. 20€-01 
‘3. 0B1E-01 
6, 1108-01 
(6. FE-OL 
6. 6846-01 
6, 9966-01 
7.208-01 
7,652-01 
8.000€-01 
8. 42-01 
8. 744€-01 
914-01 
9, 560-01 
1,000 +00 


TN-329 


1028 
1.024€+03 
1. M4 1E902 
2. 24E+01 
4. BHE+OO 
14708900 
1, 000E +00 
9, 208-01 
9,077E-O1 
9.08SE-O1 
9, 128E-01 
9, 1BBE-O1 
9. 2536-01 
9, F26E-O1 
9, MHE-O1 
9, MOE-O1 
9. S05E~01 
©, AFE-OL 
9, 75E-01 
9. 022-01 
9, 9116-01 
1, 0006 +00, 


1024 


10246903 
2.267602 
5.010601 
11266401 
2.8106 +00 
1..0006+00 
6, 3258-01 
S.7S7E-O1 
‘5.GS7E-01 
6. 10%-08 
6, 387E-01 
6. 6846-01 
6. 9968-01 
7.316801 
7.6S2E-01 
8, 0008-01 
8.346E-01 
8.7446-01 
9. NEO 
9. S80E-O1 
1.0008 +00 


83(2,A,r,au) 


1, 000E+00. 
1,000E +00, 
1,000E+00, 
1, 000€*00 
1,000E+00 
1,000E +00, 
1.000€+00 
1,.000€+00 
1,.000€+00 
1.000E +00, 
1,.000E +00, 
1,000€+00 
1. 000E+00 
1.0006 +00 
1,.000€+00 
1, 000E+00 
1, 000€+00 
1.000E+00 
1, 000E +00 
1.0006 +00 
1, 000E +00 


B02, Arey) 


2 


12,0006 +00 
1, 7286+00 
1, 494E#00 
1, 296E+00 
1,132E+00 
1,000E+00 
8. 967E-01 
8, 198E-01 
7, 66-01 
7. THE-O1 
7167-01 
7.1ME-01 
7, 232-01 
7, 40%E-01 
7, 6548-01 
7955-01 
8. 298-01 
B.679E-01 
9.070E-01 
9. SHIE-O1 
14. 000€ +00 


2 


2.000800 
1, 737E+00 
1,509 +00 
1.311400 
1, 142-00 
1,000€+00 
@.85i1E-01 
7.965E-O8 
7,RIE-O1 
4, 9316-01 
6. 7388-01 
6,7198-01 
6, 8386-01 
7.061€-01 
7. 3616-01 
7.IN7E-01 
8,1158-01 
8, S46E-01 
9.005E-01 
9.4G7E-01 
1, 0006 +00 


4, 000E +00 
2, FOE*OO 
2.232000 
1, 678E+00 
1, 2798+00 
1.000E+00 
8, 178-01 
6. 9$ME-01 
6. 256E-O1 
5. 946E-01 
‘S.078E-01 
6.030E-01 
6, 285E-01 
6,621E-01 
7.01%-01 
73-01 


for re 


4.0006 +00 
3.019400 
2.270800 
1.717800 
1. 30200 
1.0006 +00 
7, 9638-01 
6, 49-01 
5, bose -~0l 
‘5. 2048-01 
5, 2306-01 
5,005 -01 
5.7328-01 
6. 1556-01 
6,6948-01 
7.147601 
7. 6806-01 
8, 230€-01 
8, 797E-01 
9. 386E-01 
1.0006 +00 


8, 000E+00 
‘5..170E+00 
3.E+OO 
2. 174E900 
1.44400 
1,.000E+00 
7,4206-01 
6. 031E-01 
5.272E-01 
‘S.217E-01 
5.32%-01 
3.975801 
‘5. 962E-01 
6, 4E-O1 
6. 839E-01 
7.E-01 
7.B10E-O1 
8.32%-01 
8. O56E-01 
9, 4148-01 
1, 000E +00, 


8, 0006 +00 
‘S.247E+00 
3.436600 
2, B1E+00 
1, 484E +00 
1,.000€+00 
7,0898-01 
‘5.405E-01 
4,b148-01 
4. 3906-01 
4. 5268-01 
4,8768-01 
S. 3476-01 
S.878E-01 
6, 4366-01 
7,0088-01 
7,5786-01 
8, 1996-01 
8, 751E-01 
9, 3636-01 
1,0008+00 


b.312E-O1 
6. 79E-h 
7. 28%-01 
7, 7ORE-O1 


1, 600€+01 
9.126E+00 
5. 1918900 
2. 9526+00 
1, 6938400 
1.0006 +00 
6.BIE-01 
4.00XE-01 
3. 93E-O1 
3. 8906-01 
4, 1918-01 
4.b61E-01 
5.2128-01 
5.79%-01 
6. RE-O1 
6. 98E-O1 
7, S4E-O1 
8.1428-01 
8.741€-01 
9. 357E-O1 
1.0006 +00 


3. 200E+01 
1.S56EOL 
7. SAE 
3,676E*00 
1.BHE+00 
1.000E+00 
6.NE-01 
4, 00E-01 
4, 02-01 
4.@07E-01 
4, EO 
S.BiE-O1 


6. 291E-O1 
6, 779E-01 
7.27%-01 
7. 782E-01 

}. 103E-O1 
8. O43E-01 
9, 407E-O1 
1, 000€+00 


3. 200E+01 
1, S68E+01 
7, B50E*00 
3.677E+00 
1. 932E+00 
1, 000€+00 
5. 739E-01 
3. 990E-01 
3. 502E-01 
3.620€-01 
4. 030-01 
4,72-01 
5. 1648-01 
5. 7678-01 
6. 367E-01 
6. 959-01 
7. SARE-O1 
38-01 
8. 738E-01 
9. SOE-O1 
1, 000E +00, 


35 


4.S1%E-01 
4.27801 
4. 486E-O1 
4.O71E-O1 


ro) 

6. 00E+01 
2.763401 
1. 186E+01 
'S.090E+00 
2.2088 +00 
1, 000E+00 
‘5.208E-01 
3. SA1E-01 
3.216€-01 
3, 403-01 
3. 952-01 
4,S348-01 
5. 1466-01 
‘5. 739E-01 
6, 3636-01 
6. 957E-01 
7. SME-O1 
8.137E-01 
8, 7388-01 
9. E01 
1. 000E+00 


4.417E-O1 
4.C1E-O1 
‘5.310€-01 
‘5. 794E-O1 
6. 2-01 
6.77E-O1 
7.27%-01 
7. 7B1E-O1 
6.nz-O1 
6, 43E-O1 
‘9, 07E-OL 
1,000E+00 


1. 2806 +02 
4. 009E+01 
1, 798E +01 
6. 704E +00 
2. S20E 900 
1,.000E+00 
4. 747-01 
3. 1988-01 
3.028E-01 
3.374€-01 
3.913E-01 
4.518E-01 
5. 1406-01 
‘5, TS0E-08 
6.%2-01 
6. 9S7E-O1 
7. SAGE-O1 
8.137E-01 
8, 737-01 
9, S36E-01 
1,000E+00 


2. S80E+02 
8, 18SE+01 
2.9701 
0.2200 
2.688E+00 
1,000E+00 
‘S.1S7E-O1 
4.028E-01 
4,032E-01 
4.37E-01 
4, 820E-01 
5. 30-01 
5.792E-01 
6. 2BIE-O1 
6. 77E-O1 
7.27%-01 
7. 7B1E-O1 
6. 02-01 
8.6-01 
9. 407E-01 
1, 000E +00 


4.S11E-01 
‘5.137E-01 
S. TS0E-01 
6. 361E-01 
6. 9S7E-O1 
7.SAGE-O1 
8.137E-O1 
8, 737-01 
9, Z58E-O1 
1,.000E+00 


‘5.120402 
1.4202 
LIE 
1.081E901 
3.057E+00 
1,.000+00 
486-01 
3.870E-01 
3, 9686-01 
4. BE 
4.019E-01 
5. 0-01 
‘5. 791E-01 
6. BiE-01 
6. 774E-01 
7.27%-01 
7, 7B1E-01 
6. 3028-01 
8.E-01 
9.407E-O1 
1,.000E+00 


$.1206+02 
1.457E+02 
4 126901 
1, 162801 
3.2968 +00 
1, 000€+00 
3. 997-01 


6. 361E-01 
6.957E-01 
7. SA4E-O1 
6.137E-01 
6. 7378-01 
9. E01 
1,.000E+00 
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1.024803 
2.S37E+02 
6. Z1E+O1 
1.33201 
3.77600 
1,.000€+00 
3.09%-01 
2.592-01 
2. 769-01 
3.277E-01 
3.879E-01 
4, 307E-01 
$.136€-01 
S.7S5E-01 
6.361E-01 
6.957E-O1 
7. SAGE-O1 
8.137601 
8.7378-01 
9.3601 
1.0006 +00 


53(2,",ru) for r= 


‘4 


7. 210E-01 
7. 006E-01 
8.098E-01 
8,49E-01 
8.974E-01 
9.ATHE-01 
1, 0006+00 


8312,R,r,qu) 


4. 0006+00 
3.028€+00 
2. 2E+00 
1. 732400 
1.312400 
1,.0006+00 
7.75E-1 
4. 2206-01 
5.287801 
4.B45E-01 
4, 78-01 
5.001-01 
S.27E-01 
S.O71E-O1 
6.439E-01 
7.0086-01 
7.386E-O1 
8. 169-01 
8, 762-01 
9, 3708-01 
1.0006 100 


for re 


5.026E-01 
4112-01 
‘3. 838E-01 
3. 9928-01 
4. 410-01 
4. 9706-01 
‘S.SM1E-01 


8. 71-01 
9. MeE-O1 
1.0006 +00 


1. 600E+01 
9. 171E+O0 


6. BE-O1 
4, 1328-01 
3. RE-O1 
3.27%-01 
3.612-01 
167E-O1 
4.019E-01 
‘5. 498E-01 
6. 1698-01 
6.821E-01 


3.200601 
1, 996E+01 
7. FREHOO 
3.953E+00 
1, 970E +00 
1.000E+00 
5. 420-01 
3, 458E~0! 
2.053E-01 
2. 958E-01 
3, 4208-01 
4.065E-01 
4, 765E-01 
5.409E-01 
6. 1SHE-O1 
6.812E-01 
7.MA9E-O1 
8. 075E-01 
8. 701-01 
9, OE~O1 
1.0008 +00 


4021-01 
4. 70%-01 
5. 4608-01 
6, 149E-01 
6. 809E-01 
7.447E-01 
8.074E-01 
8. 701E-01 
9, OVE-01 
1. 000€ +00 


(2.67HE-O1 
3. 2H0E-O1 
4.003E-01 
4, 7HE-O1 
5.AME-O1 
6. 1486-01 
6. B0%E-O1 
7.MA7E-O1 
8,074E-01 
8. 701-01 
9. 3E-01 
1,000E-+00 


2.560602 
8.424601 
2.7601 
9.051E+00 
2..966E*00 
1.0006 +00 
3.094-01 
2.27%-01 
2.17801 
2.61501 
3.26701 
3.975E-01 
4, TSE-O1 
S.ASTE-O1 
6.148E-01 
6.907E-01 


8. 201-01 
9. SE-O1 
1,0006 +00 


5.120402 
1, 467E*O2 
4. 19E+O1 
1. 194E 01 
3. W1E+00 
1, 000€ +00, 
3, 511-01 
2.052E-01 
2.076E-01 
2. SBIE-O1 
3. ZAE-O1 
3. 9916-01 
4, THE-O1 
5. 4S4E-01 
6, 1488-01 
6, B09E-01 
7, MA7E-01 
74E-01 
8, 7016-01 
9, O9E-01 
1.000 +00 


6. BE 
1. S74E+01 
3. 901E+00 
1,000E+00 
‘BAI TBE~Ot 
1, 885E-O1 
2.017E-O1 
2.562E-O1 
3. 2E-O 
3. 9906-1 
4. 73ME-O1 
‘S,4S0E-OL 
6. 1496-01 
6, 8098-01 
7, 4A7E-01 
B.074E-O1 
TO1E-01 
9, 9E-01 
1.000400 


9. 471E-O1 
1,000€+00 


4, 0006 +00 
3.030*00 
2.00 
1, 7386400 
1.316600 
1.0006 +00 
7, 677E-01 
6.0628-01 
‘5. 030E-01 
4,332E-01 
4.WE-01 
4.7188-01 
5.17%-01 
S.7KE-01 
6. 32-01 
6. 941E-01 
7.AE-O1 
8. 1466-01 
6. THE-O1 
9. WSE-O1 
1, 000€+00 


8.0006 +00 
5.276E*00 
3.477E+00 
2. 2P1E+00 
1. S10€+00 
1, 0006+00 
6. 7478-01 
4, 7896-01 
3. 7706-01 
3.445E-01 
3. 009E-01 
4.085E-01 
4. 72Z%-01 
5.418€-01 
6. 114€-01 
6. 78E-01 
7.4E-01 
8.0728-01 
8.702-01 
9. WIE-O1 
1.0006 +00 


1. 600€+01 
9. 184E*00 
5.269800 
3. 0206-00 
1.732400 
1,000€+00 
‘5. 41E-01 
3, QBE-01 
2. 950E-01 
2.803E-01 
3.194E-01 
3. €21E-01 
4. 5616-01 
3. 321-01 
6.054E-01 
6, 7S0E-01 
7.M12-01 
8.055E-0) 
B.4P1E-O1 
9, ZHE-O1 
1, 000E+00 


3, 200€+01 
1, 599EO1 
7, 9BME=00 
3, 982E+00 
1, 9B7E*00 
1,000€+00 
5. 40E-01 
3, 1208-01 
2412-01 
2.4B6E-O1 
2. 971-01 
3, 7108-01 
4,50%-01 
‘5. 290-01 
6. 038E-01 
6. 7M0E-O1 
7.406E-01 
8.051€-01 
8.6898-01 
9. SME-O1 
1, 0006 +00 
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6, KOE +0} 
2. 704E901 
1, 2106601 
5.2528+00 
2, 280E+00 
1, 0006 +00 
4, 6306-01 
2. 5778-01 
2.06%E-01 
2. 2886-01 
2,81E-01 
3. 662-01 
4,48 1E-01 
5. 2806-01 


1.00000 
4,100€-01 
2, 106-01 
1,6266-01 
2.175E-01 
2.041E-01 
3. 0428-01 
4ATH-01 
‘5.277E-01 
6.0328-01 
6. 737-01 
7.40ME-O1 
8.050€-01 
8. 088E-01 
9.33ME-01 
1. 0006+00 


1, 673-01 
2.110€-01 
2,816E-01 
3.634E-01 
4 4716-01 
5. 2766-01 
6.032E-01 
6. 7378-01 
7, 404E-O1 
8. 0496-01 
8, bBBE-01 
9. SME-O1 
1, 0006+00 


4201 
1.205601 
2M TE+OO 
1,.000€+00 
2.207E-01 
1.619€-01 
1,.02-01 
2.07%-01 
2,.8048-01 
3.630€-01 
4, 4-01 
5.270€-01 
6.0316-01 
6, 737E-01 
7,408 -01 
8, 049E-0) 
6, 6886-01 
9. HE-01 
1,0006+00 


TN-331 


1,0288+03 
2, SSBE +02 
6, AE+OI 
1. 5906401 
3. 957E+00 
1, 000600 
2.087E-01 
1.MM1€-01 
1.505 -01 
2.051E-01 
2. 7986-01 
3.6286 -01 
449-01 
5.276E-01 
‘.031E-01 
6.737E-01 
7. MO4E-01 
8, 0496-01 
8. 688E-O1 
9, SOME-O1 
1.000€+00. 


83(2,F,r,au) 


wr 1 2 


2. 000E+00 
1, TAIE+00 
1,515E+00 
1.319400 
1, 148E+00 
1,000E+00 
8. 7XE-O1 
7, 68E-01 
6.67E-01 
1,000E*00 6. 341-01 
1,000E+00 6. 098E-O1 
1,000E*00 6. 116E-O1 
1,000E+00 6, 3326-01 
1,000E+00 6,673E-01 
1,0006+00 7,062E-01 
1,000E+00 7, S2KE-O1 
1,000E+00 7, 990-01 
1,000E+00 6. 468-01 
1,000E+00 6. 960E-O1 
1,0006+00 9. 4706-01 
1,000E+00  1..0006+00 


1.000€ +00 
1,000 +00 
1,.000€+00 
1.00000 
1.0006 +00 
1, 000E +00 
1.000€+00 
1,.000E+00 


312,A.r,eub 
wr 2 


2, 000€ +00 
1, 7416400 
1.516840 
1. 319E+00 
1, 148E +00 
1, 000€ +00 
8. 721E-O1 
7.0ATE-O1 
6.00%-01 
6.258-01 
5. 978E-01 
6.011€-01 
6. 2508-01 
6.626E-O1 
7.0568 -O1 
7913-01 


4.0006 +00 
3.G1E+00 
2. 297E+00 
1, 76E+00 
1, 318E+00 
1. 000E+00 
7.63E-01 
5. 9SE-01 
4. EOL 
4. 2098-01 
4,22%-01 
4512-01 
‘S.021E-01 
S.634E-01 
6. 2748-01 


forore 


4.0006 +00 
3.031E +00 
2, 297E+00 
1, 7416400 
1. 3198400 
1.0006 +00 
7.611E-01 
S.875E-01 
4, 7206-01 
4, 121E-01 
4.036E-01 
4, 3SE-01 
4.914€-01 
S.STIE-O1 
6. 2606-01 
6. 891E-01 
7.S2E-01 
j33E-01 
8, 744€-01 
9.501 
1, 000E +00 


}. 0006+00 
5.276400 
3, 4B1E+00 
2.295400 
1.513400 
1.0006+00 
6, 683E-01 
4,037E-01 
3.S31E-01 
3.152E-01 
3. R20E-01 
3.BHE-OL 
4, 5E-01 
‘5.310€-01 
6, 051E-01 
6. 75-01 
7419-01 
8.086301 
8, 698E-01 
9. 340E-01 
1.0006 +00 


6. 0168-01 
6. 7HE-O1 
7.411€-01 


i 


1.000E+01 
9. 188E +00 
5. 27SE+00 
3.027E+00 
1, 737E+00 
1,000E+00 
5. G56E-01 
3.6S0E-01 
‘2. bO8E-08 
2, 504E-01 
2, 6B0E-O1 
‘3. 568E-01 
4, BAE-O1 
‘5.210€-01 
‘5. 90E-01 
6. 714E-01 
7. 34-01 
O4SE-01 
s87E-01 
9, SHME-O1 
1,.000€+00 


1, 600601 
9. 189E+00 
5.2778+00 
3.0306+00 
1.739600 
1.0006 +00 
5.808 -01 
3.5296-01 
2,467E-01 
2. 52-01 
2. 634E-01 
3, 378E-01 
4. 259-01 
3.13%€-01 
5. 9S4E-01 
6.6978-01 
7, 3868-01 
8,0426-01 
8. 686E-01 
9, 30-01 
1..000€+00 


3. 20E +01 
1, 000E+01 
1, 9FEOO 
3. 9FE+00 
1, 994E+00 
1,.000E+00 
5.137E-01 
2. 904E-O1 
2.102-01 
2.15E-O1 
2, 663-08 
3. 4SE-O1 
4, 32K-01 
5.178E-01 
S.97HE-01 
6. 705-01 
7, WRE-O1 
6. 061E-01 
8, 684E-01 
9. SE-01 
1, 000E+00 


3. 2006 +01 
1, 600E+01 
7.9900 
3.997EH0 
1, 97BE*00 
1.0006 +00 
‘5.079E-O1 


4, 196E-O1 
‘5.107E-O1 


37 


4512-0 
2. MEO 
1, 7E-O1 
1. 928E-O1 
2, SE-01 
3. 400E-01 
4, 3O0E-01 
‘5. 168E-01 
S.99E-O1 
6. 02-01 
7, 3E-01 
8. 0M0E-O1 
8, O84E-01 
9.23E-01 
1,000€+00 


6, 400E+O1 
2, 786E*O1 
1.212901 
5.274€+00 
2. 294E +00 
1.000€+00 
4 AMME-01 
2. 1888-01 
1,494€-01 
1 bAE-O1 
2, 2046-01 
3.200€-01 
4173-01 
5.097E-01 
5.9928-01 
6. 6858-01 
7.37801 
8,037E-01 
8.682E-01 
9.2E-O1 
1.000600 


4. FESO 
1, 8366901 
6. 9S0E+00 
2.629E 900 
1.000E+00 
3. %7E-O1 
1.912-O1 
1,48%-O1 
1.004801 
2, 9036-01 
3.701 
4. 2E-N 
5. 165E-O1 
S.97E-O1 
6.702E-01 
7. WE-O1 
8, 040E-01 
8. 6848-01 
9. BE-01 
1.000€+00 


1, 2006+02 
4. BS0E*01 
1.637E+01 
6. 957E+00 
2.0355 +00 
1,.000€+00 
3.891E-01 
1, 747E-OL 
1. 2408-01 
1,S19€-01 
2, 738E-01 
3.177E-01 
4, 164E-01 
5.094E-01 
S.931E-01 
6,684E-01 
7,37RE-01 
8,037E-01 
8.682-01 
9. 3528-01 
1.0006 +00 


312 1024 


2, S0EH02 
8.UE01 
2. 7RAE*O1 
9. 170E#00 
3.019E 900 
1,.000E +00. 
3.49H-O1 
1, SRRE~O 
1.2K-O1 
1, 74E-OL 
2.4701 
3. 69-01 
4, E01 
5. 1648-01 
S.967E-01 
6. 702-01 
7.BE-OL 
8. 0M0E-01 
8. O84E-O1 
9. BE-O1 
1..000E +00 


‘5.120E+02 
1,470+02 
4. 2198901 
1.210890 
3. 467E*00 
1,000E +00 
3.0B1E-01 
1-01 
1.2068-01 
1.695E-01 
2.4E-01 
3.365E-01 


1.024903 
2. SS7E02 
6. 7EO1 
1, 596E+01 
3. 9B1E+00 
1,.000E+00 
2.7ZE-O1 
1.1STE-OL 
1. 14E-O1 
167-01 
2.4S6E-O1 
2.BEO 


1024 
1,024E*03 
2.960E+02 
6, 398E*O1 
1. S99EO1 
2, 992900 
1,000E+00 
2.627801 
9.72702 
8, 984E-02 
1.3B1E-01 
2. 1898-01 
3,1628-01 
4. 1998-01 


2. S60E+02 
6, 444€ +0) 
2. 785E+01 
9. 182E900 
3.026E+00 
1, 000€ +00 
3.410€-01 
1,415E-01 
1.0728-01 
1. 47E-01 
2.210€-01 
3. 168E-01 
4. 161E-01 


5.120€902 
1, 470E+02 
4, Z21E+01 
1.212801 
3.47SE+00 
1,000€+00 
2.992-01 
1, 1648-01 
9.014E-02 
1.405E-01 
2.196E-01 
3.103E-01 
4. 160E-01 
5.0°2E-01 
S.990E-01 
6.004E-O1 
7. 378E-01 
8.037E-O1 
0.082-01 
9.BE-O1 
1,000E+00 


TN-332 


83(2,F,r,au) 


1,000E+00 
1, 0006400 
1,000E+00 
1,0006+00 
1,006 +00 
1,000E+00 
1,.000E +00 
1,000E+00 
1,000 +00 
1,000E+00 
1.0008 +00 
1,006 +00 
1.000€+00 
1.0006 +00 
1,000€+00 
1,000€+00 
1, 0006 +00 
1, 0006 +00 
1, 000€ +00 
1.0006 +00 


BZA rm) 


2 


2, 000E+00 
1. 741E900 
1.516600 
1.319690 
1. 149E+00 
1,.0006+00 
8, 714E-O1 
7.62E-01 
4. 7S0E-01 
6, 1S2E-01 
5.082E-01 
5.9298-01 
6,202-01 
6,5968-01 
7. 042-01 
7. S07E-01 
7,981E-01 
8. AeAE-01 
8, 958€-01 
9, 469E-01 
1. 0006+00 


2 


2.0006 +00 
1. 7H1E+00 
1,516E+00 
1.319900 
1. 1496400 
1,000 +00 
8.711E-01 
7. 608E-01 
6.7128-01 
.085E-01 
5.803E-01 
5.B63E-01 
6, 162E-01 
6.S78E-01 
7.05%-01 
7.90%-01 
7. 980E-O1 


8. 958E-01 
9.469 -01 
1, 000E +00, 


fore 


4.0006+00 
B.0B1E+00 
2.297E+00 
1, 7A1E+00 
1.319800 
1.0006 +00 
1.901 
5.630E-01 
4.626E-01 
3. 981E-01 
3.08E-O1 
4. 25€-01 
4, 8378-01 
5. S30E-01 
6. 21-01 
6, 683E-01 
7.S16E-01 
8, 1326-01 
8, 743€-01 
9, 262E-01 
1.000E +00 


fore 


4.0006 +00 
3.031E+00 
2. TE 
1, 71E+00 
1. 3196400 
1.0006 +00 
7.5896-01 
5.Q00E-01 
4,S57E-01 
3.870€-01 
3. 761E-01 
4,138E-01 
4. 7BIE-01 
5. S04E-01 
6.211E-01 
6.879E-01 
7,S1-01 


9. BE 
1. 000E +00 


me 


1.515E+00 
1.000€+00 
6, 6268-01 
4.4701 
3.258-01 
2.78E-01 
2.9%-01 
3. 525-01 
4, 47E-01 
5.199E-01 
5.995E-01 
6.7278-01 
7. 408E-01 

}- OS8E-01 
8. 4968-01 
9. TOVE-01 
1.0006 +00 


3. 13-01 
2.613-01 
2. 7ede-O1 
3.1301 
4, 284E-01 
5. 169-01 
5.984E~01 
6.7238-01 
|. HOGE~O1 
. OSTE-O1 
G.490E-O1 
9. Z9E-01 
1,.000€+00, 


iT 


1.6006+01 
9. 189E+00 
5.27800 
2.QB1E+00 
1, 740E+00 
1, 000E +00 
5. 7B1E-O1 
3, 4S0E-01 
2.321E-01 
2. 064E-01 
2. A34E-O1 
3. 2206-01 
4,1708-01 
S.0ME-O1 
5. 933-01 
6, 688E-01 
7. BE-01 
8.041E-01 
8. 0BSE-O1 
9, 333-01 
1.00000 


16 
1, 600601 
9. 1906+00 
5. 778€+00 
3. 031E+00 
1. 741E+00 
1, 0006990 
5.7658-01 
3, 3986-01 
2.2138-01 
1.897E-01 
2.2748-01 
3. 1086-01 
4. 1046-01 
S.064E-01 
5.921€-01 
6.6848-01 
7. 2iE-O1 
8, 0406-01 
8, 685-01 
9. 35-01 
1. 000€+00 


3. 200E+01 
1.600640) 
7. IFFCO. 
3.998100 
1. 999E+00 
41,0008 +00 
‘5.08SE-01 
2,674E-01 
1.720€-01 
1, 6S5E-01 
2.201E-01 
3.079E-01 
4105-01 
‘5. 061E-01 
5. 9166-03 
6.6796-01 
7. 370E-O1 
8,.036E-0) 
8, 682-01 
9, 332E-01 
1.0006+00 


3.200640) 
1, 600E+0) 
8. 000€ +00 
4, 000E +00, 
2.0006 +00 
1.0006 +00 
5.026E-01 
2.614€-01 
L.6O1e-o1 
1, 487E-01 
2.031€-01 
2.978E-01 
4.0396-01 
S.031E-01 
5.904E-01 
6.674€-01 
1.37E-O1 
8. 036E-01 
6.662-01 
9. 32E-01 
1,000 +00 
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E, APPENDIX - Notes and Errata 


The notes listed below are included to bring attention to notation and other problems. The page 
number provides reference to the location of the problem or comment. 


1. 
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AM noise is especially important in the measurement of the (residual) phase noise added 
by amplifiers and other signal handling components. Often the driving source for the 
measurements is a frequency synthesizer that has phase and/or amplitude noise that is 
comparable or larger than the added noise of the component under test. Most measure- 
ment systems are configured so that the phase noise of the source cancels out to a large 
degree (at high Fourier frequencies decorrelation effects limit the cancellation). In such 
measurement systems, the AM to PM conversion factor and the AM noise of the source 
may then set the noise floor, Discussion of the effect of AM noise and AM to PM 
conversion factors on the accuracy and precision of phase noise measurements is found in 
"Residual Phase Noise Measurements of vhf, uhf, and Microwave Components" by G. K. 
Montress, T. E. Parker, and M. J. Loboda Proc. 43rd Annual Symposium on Frequency 
Control, pp. 349-359 (1989) and in "Accuracy Model for Phase Noise Measurements by F. 
L. Walls, C. M. Felton, and A. J. D. Clements, 2/st Annual Precision Time and Time 
Interval Meeting (1989). The notation in these papers as well as that in other parts of the 
literature differs from that given below. Our notation below is drawn from a modest level 
of consensus among individuals responsible for setting standards. We expect that it will 
gradually be adopted within standards committees. The following comments are directed 
specifically at the specification of noise performance. 


The total power spectral density in a signal can be approximated by expanding eq 12-5 of 
paper B.2 (by Stein) and extending it to include the spectral density of relative amplitude 
fluctuations, S,(f). The double-sideband density written in single-sideband form is given by 


Sy) = Ble Mp ve MNS] —O< F<, 


where 


1G) = [Sar 
£ 


I(f) is the integrated phase modulation due to the pedestal and 6(f) represents the carrier 
with frequency width +f. The effect of large S,(f) on power in the carrier has not, to our 
knowledge, been explored. The power spectral density of relative phase fluctuations, S,(f), 
is normalized to one rad’/Hz and S,(f) is normalized to the carrier voltage, but the total 
power spectral density, S,(f) is not normalized and has the units of V’/Hz. All of these 
are single-sided spectral densities. For most measurement purposes, we can disregard the 
carrier and find that, away from the carrier, the above expression simplifies to 


SUf) =< suf) + 5.0)] for O<fs~. 
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The more general expression is important only very near the carrier and in certain types 
of frequency multiplication. The single-sideband, amplitude noise, normalized to the total 
signal power is given simply by S,(f) for 0 < f< ©. The measurement of added phase and 
amplitude noise for amplifiers and other signal handling components should specify the 
signal level since the AM noise level and the contribution due to AM-to-PM conversion 
depend on the signal level. 


page TN-6 

For a direct measurement, time accuracy only has meaning when the phase of the time- 
base oscillator of the frequency counter is known with respect to some time standard. 
Either it is phase locked or is calibrated with respect to that standard at the time of 
measurement. The phase of the time-base oscillator can then be measured with respect 
to the phase of the frequency standard being calibrated (accounting for cable delays, etc.). 
Except for the cycle ambiguity of the carrier, the phase of the frequency standard being 
measured can carry time information and have time accuracy, This technique is not 
common, but is very useful and eliminates divider noise that typically occurs in going from 
5 or 10 Mhz to | pulse per second. Caution must be exercised to assure that the phase 
point measured in a sine wave is at a reproducible voltage and impedance so that the cycle 
ambiguity is an exact integer. 


3: 
A second-order servo loop provides substantially enhanced performance. See, for example, 
F.L. Walls and S.R, Stein, "Servo techniques in oscillators and measurement systems," NBS 
Tech. Note 692 (1976). 


page TN-35 
This error can be identified and corrected using the phase modulation scheme described 
in paper B.4 on page TN-136. 


page TN-36 


Low-noise DC amplifiers have been substantially improved since publication of this paper. 


ie x g 17. 5 5 
The reader is reminded that the discussions of frequency-domain measurements assume 
incoherent noise processes. Often the phase noise spectrum of a signal will contain bright 
spectral features (spurious lines) other than the carrier. Frequency-domain measurements 
are often useful in identifying such features. But if these spurious lines are narrow 
compared to the measurement bandwidth, statistical measures such as S,(f) and #(f) are 
not appropriate. It is better to specify the phase deviation in terms of the rms value of 
the phase deviations, $,,,,(rms radians), without reference to bandwidth. This specifica- 
tion in rms radians can be related to the Allan variance (see note # 8 below). 


Humidity is often an important environmental factor. See, for example, J.E. Gray, H.E. 
Machlan and D.W. Allan, "The Effect of humidity on commercial cesium beam atomic 
clocks," 42nd Annual Symp. on Frequency Control, pp. 514-518 (1988) and F.L. Walls, "The 
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Influence of Pressure and Humidity on the Medium and Long-Term Frequency Stability 
of Quartz Oscillators," 42nd Annual Syinp. on Frequency Control, pp. 279-283 (1988). 


e TN-7: 
For a bright line (one which is narrow compared with the measurement bandwidth), the 
solution of eq 12-27 simplifies to 


sin’(nft), 


9,(*) = ty 


V2 Orns 

ot 
where $,msis the rms value of the phase deviations, The above relationship may be useful 
where one is trying to determine the effect of a bright line in the time domain. If the 
bright line is the dominant factor, the plot of o,(T) versus 7 has strong sin*(wfr) oscilla- 
tions and it can be ambiguous. In that case, it is better to provide a specification in terms 
of ,msWithout reference to bandwidth, Statistical measures such as 0,(1) and S,(f) are 
not meant to be used to describe coherent signals. For further discussion see paper B.1, 
section 12.2 (page TN-51). 


-7: 
A set of brackets, [ ], are missing in eq 12-29. The equation should read 


N-3ne1 [nej-1 2 


1 DY Gan Mien X)] + 


moda}() 2 
20?7N7(1N-3n+1) ja | ty 


page TN-119 
The reference (Walls and DeMarchi, 1975) is listed as being on pages 310-317. The page 
numbers should be 210-217. 


Most of the literature uses the expression [Vo + €(t)] instead of Vg as in eq (2). Vo is the 
peak voltage amplitude and €(t) is the voltage deviation of the amplitude from nominal. 


In eq (5), most of the literature uses x;(t) instead of €(t). €(t) is usually the voltage 
deviation as described in note 11 above. 


page TN-123 
There is an error in the caption for figure 7, The last portion of that caption should read: 
"where f is Fourier frequency ((w = 2mf) and Sup = oS, (f))." 


In the right-hand column, last paragraph, Sth line, there is an extraneous minus sign. The 
quantity y;"° should read y7°. Also, note that the use of supercript t and T9 with ¥ is 
not consistent with the new IEEE standard definitions (see paper C.1, page TN-139). 
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15. 


16. 


18. 


20. 


21. 


page TN-124 
In eq 9 the subscript, k - n, should read k + n. That is, the equation should read 
ken-l 


a 1 sto ken 
Me »» yi toa 


The quantity ar) is now commonly known as modoj(r). This latter form has been 
recently adopted by IEEE as the standard terminology. 


page TN-139 

TEEE Std 1139-1988, JEEE Standard Definitions of Physical Quantities for Fundamental 
Frequency and Time Metrology, is an almost exact replica of this paper (D.1). The paper 
was published during the latter period of the development of the standard. The only 
substantial difference is that, wherever it occurs, the word "departure" in the paper is 
replaced in the IEEE standard by “deviation.” 


This widely cited paper provided the de facto standards for terminology and oscillator 
characterization until the recent adoption of the IEEE standard presented in paper C.1 
(page TN-139). For terminology, the latest IEEE standard should always take precedence. 
This paper (C.2) is fairly consistent with the IEEE standard. One exception is that, in this 
paper, N denotes the number of frequency measurements. The symbol M in the IEEE 
standard is the same as N in this paper. In the standard, the equation relating M and N 
isM=N-1. 


Equation (23) can be substantially simplified as shown, for example, by Stein (page TN-74, 
eq (12-27)), which is 


zy 
(nvgt)? 


o,(t) - 


[Sy )sin' apt df. 
oO 


In eq 36 the T outside the brackets should be a r. The equation should read 


() - At, -T. 
R(ty+t) - x) ee 


T 
page TN-160 
The 2 expressions listed as eq (95) are in error. They should read 
~h_w7[3 + 2inr - 1/(6r?)] r>1 
~h_,T"[3 - 2inr] r<l. 
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24. 


25. 


26. 


27. 


/-160 
In eqs (101), (102), (103), (104), and (105), a Greek y was mistakenly replaced by the 
number 2. In each of these equations the quantity [2 + In(2mf,7)] should be replaced by 
the quantity [y + In(2#f,1)]. 7, Euler's constant, has the value 0.5772156649........ 


page TN-162 

This paper is included in this collection because it presents the internationally accepted 
terminology and definitions. There are no substantial inconsistencies with the new IEEE 
standard (paper C.1, page TN-139), but the latest IEEE standard should is considered to 
be the most up-to-date authority. A new version of this international report should: be 


issued by the CCIR in 1990. 


The definitions for symbols used in this paper are fairly consistent with those adopted in 
the recent IEEE standard (C.1). One exception is that, in this paper, N denotes the 
number of frequency measurements. The symbol M in the IEEE standard is the same as 
N in this paper. Another is that, while this paper uses 4 as the exponent of 1 in describ- 
ing the power-law noise processes, the paper adopts the opposite sign convention for 4. 
v(t) is used where many other papers use V(t) for instantaneous voltage. Some confusion 
is generated when this small v is typeset in the equations to look almost identical to the 
Greek v, a symbol which is used exclusively to represent frequency. For example, In 
equation (1) the left-hand quantity is voltage, whereas the v(t) and v, in equation (4) are 
clearly frequencies. Finally, the authors of this paper, in equation (2), define €(t) as the 
normalized amplitude fluctuations, a very sound choice, but the reader should note that 
most other papers have not normalized it. 


page TN-175 
For consistency with figure 12 and the text, v(t), the left-hand member of eq (11) should 
probably be u(t). 


page TN-177 
Walls, Percival and Irelan (D.4) have recently addressed the more accurate specification 
of the quantity p in eq (12). 


page TN-179 

It is important to note that the expressions in Table 2 in this paper are derived assuming 
use of a single-pole filter. The calculations can also be done using an ideal (infinitely 
sharp) filter. The solutions in these two limits are useful because they define the range of 
practical values (using n-pole filters) for the expressions. Table I in this section is an 
expansion of Table 2 of Lesage and Audoin providing both the single-pole results as well 
as the results for an infinitely sharp filter. There are discrepencies in several of the coeffi- 
cients between terms in Table 2 in the paper and those in Table I on the next page. 


page TN-180 
Barnes and Allan (paper D.8) have recently completed further analysis of the effect of 
dead time on measurements. 
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f, is the measurement 


Table I. Asymptotic forms of oy(r) for various power-law types and two filter types. Note: w,/2m 


system bandwidth, often called the high-frequency cutoff. In = loge. 


2 
o,(1) 


so 


Name of Noise 


wT<<i 
Single Pole 


7 <<1 
Infinite Sharp 


w7>>1 
Single Pole 


7 >>1 
Infinite Sharp 


Filter 


Filter 


Filter 


Filter 


2m7f 77h, 


3f,h, 


3f,h, 


White Phase 


2r 


(2m)'r? 


(2m)'r? 


wih, 
= 2ff(1n(2))h, 


Gln(o,7))h, 
(2)? 


(1.038 + 3in(w,7))h, 
(2m)'r? 


hf 


Flicker Phase 
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2r*t3r7h, 


= 


x 


0 


White Frequency 


2r 


2r 


2(In(2))h., wrh, 


2(In(2))h., 


-1 


Flicker Frequency 


2 


Random-Walk 
Frequency 


30. 


31. 


33. 


34, 


36. 


37. 
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If the ratio of T/r is constant and greater than 1 (the usual case), the problem described 
is eliminated. However, in taking data for a plot of oy(1) versus 7, it is difficult to 
achieve this in the hardware and not possible to do it with software processing alone. For 
further discussion see paper D.8 (page TN-296). 


page TN-197 

The most recent definitions and concepts for spectral density are given in a new IEEE 
standard (paper C.1 on page TN-138). This new standard should be consulted as the latest 
authority on definitions and terminology. 


page TN-198 

The newly accepted definition of #(f) is given in paper C.1. This new definition, #(f) = 
%S,(f), was always valid for Fourier frequencies far from the carrier. It has now been 
extended to cover all frequencies. 


-217 
Equation (73) should read 20log(final frequency/original frequency). 


a -239 
On page TN-198 the authors refer to a paper by Glaze (1970). The reference, apparently 
lost in printing, is: Glaze, D.J. (1970). "Improvements in Atomic Beam Frequency Stan- 
dards at the National Bureau of Standards, "[EEE Trans. Instrum. Meas. IM-19(3), 156-160. 


page TN-257 

There are two errors in Table 2. Under R(n) the first entry should be 1/n rather than 1. 
The second item in the same column is not single valued (1), but takes on different values 
for different measurement bandwidths. The reader is referred to section A.6 (page TN-9) 
for a discussion of this topic. 


S -26 5 
Subsequent work on modo;(r) and R(n) is reported in section A.6 (page TN-9) of this 
report. There are some differences between the results in A.6 and the ones reported in 
Tables I and II and Figure 4 in this paper. 


page TN-264 
To be consistent with other papers in the literature, ¢(t) in eq (1) should probably be 
written as x,(t). 


age TN-268 
The term €(t) in eq (3) is normally used to represent the amplitude fluctuations in the 
output voltage of an oscillator. This term might be better designated Y(t). 
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